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LEADERSHIP FOR CHANGE; 
A REPORT OF THE OUTREACH LEADERSHIP NETWORK 



This abstract from the full final reports of the OLN project is 
being widely disseminated to- interest groups concerned with 
change, education and librarianship in this model and further 
applications of it. The complete document includes a descriptive 
report -and an evaluative report which detail why and how the 
project was done together with the outcomes and implications of 
the project that are evidenced at this time. The full report 
will be available through the ERIC/CLIS document series. For 
those interested in the model, a limited number of printed copies 
is available from the OLN Project Coordinator, Margaret B. Soper, 
Division of Continuing Education, University of New Hampshire, 
Durham, New Hampshire. 

Project staff members will welcome your comments, reactions or 
questions regarding the project. We urge you to use the dialogue 
sheet included in this abstract report to let us know your area 
of interest. 



The Outreach Leadership Network (OLN) was a regional program of 
continuing education for public librarians in New England and was affiliated 
with the New England Center for Continuing Education at the University of 
New Hampshire in Durham. Federally funded under the Higher Education Act 
(Title 11 B) , the project began July, 1971, and continued formal activities 
through October, 1972. The overall goal of the project was that of providing 
for more effective programs of public library services directed toward" 
presently unserved community groups. 

OLN, sought to provide educational programs' which would increase the 
ability of New England librarians to plan and launch successful and effective 
programs to actively extend library services to more citizens than presently 
were being served. This outreach educational program also served as a training 
ground for the development of a cadre of public library leaders — librarians 
not only committed to outreach service but also skilled in program planning 
and in working with groups. Project activities provided multiple opportunities 
for outreach-committed librarians to "network^' with each other; that is, to 
share ideas and resources within each state and across state lines. 

OLN was essentially an attempt at outreach to the library profession 
using a continuing education program to effect regional impact in promoting 
active delivery of library services beyond client groups now served. It sought 
to activate a significant number of librarians who would provide an impact of 
outreach librarianship into New England library service patterns. Hoped for 
as an outcome from the project is the development of an outreach network among 
New England librarians to be used for the communications and decision -making 
functions necessary to facilitate further state and regional public library 
outreach efforts. 
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The project itself is a model of planned change, an example of the 
attitudes and skills it sought to ''teach''. It was based on thia principles 
of participatory management and of planned organizational development as 
well as those of educational technology and participative education. This 
model was intended to be relevant for librarians in working with their 
communities and colleagues, for administrators in working with their staffs 
and trustees and for state agency personnel in working with their librarian- 
clients . 

OUTREACH LIBRARIANSHIP AND CHANGE 



Outreach librarianship seeks to extend library service beyond the 
traditional patterns and through the traditional barriers by using new 
methods, new media^ new strategies — or the old ones in new ways. Most 
fundamentally, successful outreach library programs are done by the 
librarian with the community, not by the librarian for the community. 
In this changing world, librarians need to develop the necessary abilities 
and attitudes for outreach librarianship. Libraries need to build 
policies and programs which are closely related to community needs and 
which incorporate community involvement in new ways. The community needs 
to change in relation to the library by being actively involved in the 
planning and use of library services. The initiative for outreach 
library programming can come from any of these elements — librarians, 
libraries, communities — but it will need all these elements in order 
to succeed. 

To move from traditional to outreach service patterns requires change 
and understanding of change for the individual and for the library. 
Initiating that shift and sustaining it means working through the ever- 
lasting process of growth which is change. An important capability for a 
lasting institution, as well as for a healthy individual, is the ability 
to change — to plan for change and to accommodate changes that occur, 
rather than be. bypassed or destroyed by the impact of those changes. 

All activities throughout the project were intended as practical 
applications of theory and as opportunities to learn. Major staff efforts 
were: 

1. to establish and maintain an administrative base which could assemble 
and coordinate needed resources, 

2. to develop a leadership training program which would provide a series 
of learning opportunities for librarians who indicated a high degree 
of leadership potential, 

3. to produce four outreach institute programs which would develop the 
attitude and ability needed for effective outreach librarianship in 
participating New England librarians. 

Briefly stated, OLN was a model of an evolving organizational structure 
which produced participative education activities. These activities consisted 
of action training and leadership development programs which were systematically 
designed to deepen commitment and increase the capabilities of public librarians 
in New England interested in outreach librarianship. Throughout its life, 
the organization was administered by means of participatory management methods 
using ad hoc task teams. From the beginning the OLN was meant to be «;ransf erred 
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into the hands of those who had been active in its prorram and who were most 
committed to its goals and methods. The intent of the proposers and staff 
of the project was not only to build an operational structure for its 
funded life but to evolve a method which could extend the initial thrust 
into the future. Thus, if relevant and timely, this process might continue 
to enable public librarians in New England to ''participate meaningfully 
in the process of planning and effecting constructive changes in their world. 

PROJECT OUTCOMES 

To what extent these intentions have been fulfilled is not yet completely 
clear but substantive evidence shows strong indications that the OLN project 
was able to produce the resources necessary that could be used to build on 
and to sustain the impetus provided by the initial catalysit. Within this one 
and one-half year period, an extensive bank of resources (people, ideas and 
materials) has been developed. More specifically project outcomes include: 

Librarians (113 participants of the Oucreach Institutes and 69 
involved in the training programs) with a high leadership potential, 
a commitment to outreach and an action orientation have shared learning 
experiences across state lines. They are trained in the ability to 
plan and implement programs; they have established communication 
with each other and have a regional outlook; they have evidenced 
their interest in continuing education with a view of their own 
learning needs and new perspectives on how to fill those needs. 
Idea Resources were provided by the practical application of the 
project^s methodological approach, the concepts of participatory 
management, organizational development and participative education 
can be considered for application in library schools, state agencies 
and other projects as well as for librarians to utilize in their 
libraries. In addition, values of networking, of working collaboratively 
on a c{ man task and of involving the community in decision-making were 
discovered by many who have been involved directly in the program. 
Materials Resources compiled for the project acti^/ities included a 
step-by-step action planning model, an outreach bibliography, a 
brochure describing the project, workshop designs, documentation forms 
for meetings and workshop sessions and a collection of outreach 
information and training resources. 

The next step to fulfill the intent of the model is for New England 
librarians to utilize these resources and take initiative and responsible 
move» to sustain or redirect the thrust begun by the project. The skills of 
action-planning are already being directly ar.d immediately employed by key 
leaders who were involved in the program. As a result of their shared 
interests and concerns, two groups have formed and, through the fall of 1972, 
have firmed up action plans, integrated and coordinated their efforts to 
reveal that the elements of the next steps — New England librarians 
utilizing these resources and taking initiative and responsibility — are 
possible, feasible and in view'. A Task Force on an Outreach Information 
Clearinghouse seeks "to consider and implement the idea of an Outreach 
Information Clearinghouse, a centralized continuing activity for the collection, 
organization and dissemination of information about outreach." A Steering 
Committee seeks to provide for the organizational continuity of the project. 
This group in conjunction with the Continuing Education Committee (a sub- 
committee of the Regional Planning Committee) of the New England Library 
Association has petitioned and become a section of NELA to be known as 
New England Outreach Network (NEON) . These are indications of the present 
and potential impact of this project. 

iii 



PROJECT EVALUATION 



A team of three outside evaluators was responsible for the design and 
implementation of an evaluation plan to measxire the effect of the project's 
institutes and training program experiences on the participants involved. 
The evaluation plan was intended to guide programming and to determine the 
degree of effectiveness of major elements of the total program. An 
evaluation mode] developed at Ohio State University, known as CIPP, was the 
basis for the evaluation plan by the Evaluation Team. 

Evaluation is defined as ''the* process of delineating, obtaining, and 
providing useful and appropriate information. According to the CIPP model, 
there arc four types of evaluation ~ Context, Input, Process, Product ~ 
which examine four general types of decisions which must be made during any 
meaningful cycle of project planning and implementation. These are: 
Context Evaluation is the examination of planning decisions which determine 
objectives and set priorities, and thus specify major changes that are 
needed in a program. Input Evaluation is the examination of structuring 
decisions which project strategies for the achievement of the objectives, 
and thus are the means to achieve the ends- which have been established; 
they can also result in the modification of established objectives as- 
limitations of available resources to insure their achievement are revealed. 
Process Evaluation is the examination of impletnenting decisions which are 
involved in executing the designs and involve mmy choices regarding changes 
of ongoing procedures. Product Evaluation is the examination of recycling 
decisions whereby achievements are measured against objectives and a 
determination is made whether to continue, modify, or terminate a project. 

The broad range of skills required to satisfy the evaluation require- 
ments m the Plan of Operation indicated the need for a team, which is 
consistent with the OLN training model. The Evaluation Teasi combined skills 
and experience which include expertise in fields of adult education, human 
relations, organizational development, evaluation, library systeins planning, 
regional programming, needs assessment, snd leadership training. ' 

The Evaluation Team performed the following functions in the OLN program: 

1. developed the theoretical framework and means by which the urogram 
objectives could be evaluated, giving attention to both process and 
product as defined by the CIP? model; 

2. served as skilled process observers in selected program activities of 
OLN throughout the duration of the program for the purpose of providing 
data which could be used as a basis for strengthening the program as it 
progressed; 

3. assisted stafr, and participants in clarifying the objectives which 
they pursued xn various training activities of institutes; 

4. were involved in the development and use of documentation forms which 
were designed to provide information about activities, individual's 
process abilities and self-evaluation. 

5. aided the participants to understand and practice evaluation techniques 
as applied to outreach, librarianship; 

6. responded to requests of institute staff and some participants during 
institutes and follow-up activities as con&'ultants on planning, problem- 
solving, and evaluation. 

iv 



ERLC 



The OLN was a complex project to evaluate. As of Novenfcer, 1972, the 
Outreach Leadership Program included fifty-seven •"'formal'' events anct an 
undetermined number of informal events that emerged from the considerable 
number of professional meetings which OLN participants attended. Since 
neither time nor money permitted members of the Evaluation Team to be 
present at all of these events, documentati^a reports, staff reports, and 
correspondence wrire used by the Evaluation Team to provide the information 
needed about the various meeCiings and workshops, and the activities which 
resulted from them. This multi-faceted approach toward evaluation was 
adopted primarily for two reasons: first, the sheer quantity of activities 
which occurred, sometimes concurrently, operated against direct personal 
observation of them by an Evaluation Team member. Second, the very nature 
, of many institute activities does not fit well into discrete quantifiable 
analyses. The fact that attidudinal and behavioral changes were occurring 
to some degree in at least 135 individual personalities in different 
directions and at different rates, illustrates another dimension of 
complexity in the evaluation process. 

The primary sources of information used by the Team to study the 
effectiveness of the institutes are derived from the direct participation 
of the Evaluation Team, notes, Workshop Evaluation Questionnaires, Summaries 
Of Action Plans written by participants, and the recorded responses to the 
Post Institute Survey Questionnaire. 

Although the application of leadership skills acquired as a direct 
result of participation in the OLN programs cannot, in this short a time, 
be assessed with accuracy or reliability, evidences of leadership tendencies 
were revealed to some extent by participation in program activities, 
including follow-up activi.ties, implementation of action plans, and self- 
evaluation of outreach leadership skills. 

f OBSERVATIONS 

The following are some of the observations made by the Evaluation Team: 

1* The opportunity and eno ^jfagemcnt of participants and staff to 

participate openly and actively in the planning, design, implementation, 
and evaluation contributed significantly to the accomplishment of the 
goals and objectives of the program. 

2« The multi-person approach to decision-making used throughout the project 
tended to overcouie autocratic 'imposition of those decisions and gained 
early commitment to their success on the part of the decision-makers. 

3. Some staff members pnd participants exhibited solid patterns of personal 
and professional development of outreach and leadership skills. 

4. Location of the OLl^ project in an existing regional institutional 
setting enabled resource people to be utilized who already were committed 
to regional concepts and who utilized network relationships that had 
been developed among institutions in the region. 

5. While the goals of the OLN institutes were directed toward improving 
services to unre^iched groups, the skills c^nd concepts imparted by the 
training program were generic to the overall improvement of basic 
libtary services. 

6. .ks a result of exposure to the OLN program "outreach concept", the 
materials, staff, skills, were in soine cases, adopted by other library 
personnel and non-OLN agencies, both in New England and nationally. 

7. A "temporary system" such as OLN is not encunfcered with the restrictions 
of an institutionalized system and can introduce innovations without 
dealing with the established procedures of an existing system; 
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Recommendations based on the findings made by the Evaluation Team are 
included in the report as information upon which decisions can be made by 
those who plan similar programs. These relate to program design, selection 
criteria and procedure, utilization of documentation process and forms, 
workshop design and implementation, staff and faculty roles, evaluative 
process and procedures, and possible next steps. A strong suggestion for 
a longitudinal impact study was made with such a study to be conducted 
approximately two years after the completion of the project. This study 
could measure outcomes that cannot be evaluated while the project is being 
conducted, and to determine the long-term effects of the project on outreach 
librarianship in New England. 
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TO INITIATE DIALOGUE.... 

This abstract of the descriptive and evaluative reports of the GLN 
project is given wide distribution in the hopes of providing brief 
and essential information about the project to librarians, state 
library agencies, professional associations and educators • This 
sheet is designed to provide a means for further communication to 
be used by those who are interested in this project and/or the 
report in hand. The project staff and evaluators welcome your 
interest, comments, reactions and questions. For your convenience, 
this form is provided to assure the prompt referral of your response 
tc the appropriate persons • Correspondence should be sent to: 
Margaret Soper, Project Coordinator, Outreach Leadership Network, 
New England Center, Durham, New Hampshire, 03824. 

Would you be Interested in additional information regarding the 
OLN project? If so, in what particular aspect? 



Would you share your reaction to this report? 



Would you be Interested in knowing future directions being taken 
in outreach librarianship in New England? 



Do you know of other individuals or groups who would be interested 
in this project who may not have received this report? List: 



Do you have similar interests , goals or methods and want to share 
learnings with us? If so, describe your particular focus so we 
msy respond ♦ 



Other comments: 



Your name, title and institutional address: 
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Parti: Administrative Report 
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"WE CAN LIFT OURSELVES OUT OF IGNORANCE, 

WE CAN FIND OURSELVES AS CREATURES OF EXCELLENCE AND INTELLIGENCE AND SKILL. 
WE CAN BE FREE. 

. WE CAN LEARN TO FLY!" 



Bach, R. Jonathan Livingston Seag ull. 
N.Y., Macmillan, 1970. ^~ 



INTRODUCTION 

The Outreach Leadership Network (OLN) was a regional program 
of continuing education for public librarians ir. New England and 
was affiliated with the' New England Center for Continuing 
Education at the University of New Hampshire in Durham. Federally 
funded under the Higher Education Act (Title 11 B), the project 
began July, 1971, and continued formal activities through October, 
1972. The overall goal of the project was that of providing for 
more effective programs of public library services directed 
toward presently unserved community groups. 

OLN sought to provide an educational program which would 
increase the ability of New England librarians to plan and launch 
successful and effective programs which would actively extend 
services of their libraries to more citizens than presently were 
being served. This outreach educational program also served as a 
training ground for the development of a core of public library 
leaders — librarians not only committed to outreach service but 
also skilled in program planning and in working with groups. The 
program provided multiple opportunities for outraach-committed 
librarians to "network" with each other; that is, to share ideas 
and resources within each state and across state lines. These 



elements served as the basis for an outreach network which may 
develop as an outcome from the project. 

Two basic program objectives threaded through all activities. 
The first was to develop the ability of public librarians to 
formulate and implement action programs of library outreach — 
extending their library service beyond the traditional patterns to 
segments of their conuiunity not presently adequately served. The 
second was to develop a core of library leadership able to evolve 
a network which could continue the impetus of the project beyond 
the duration of the funded period. Hoped for as an outcome from 
the project was the development of a network among New England 
librarians which can be used for the communications and decision- 
making functions necessary to facilitate further state and regional 
public library outreach efforts. 

OLN was essentially an attempt at outreach to the library 
profession using a continuing education program to effect regional 
impact in promoting active delivery of library services beyond 
client groups now served. It sought to activate a significant 
number of librarians to provide an impact of outreach librarianship 
into New England library service patterns. 

The project itself was a model of planned change, an example 
of the attitudes and skills it sought to "teach". As such, the 
project was an outreach effort with a conmunity of librarians who 
became deeply involved with the planning, implementing and 
evaluating. The depth of change necessary to produce new patterns 
of behavior and institutional policy requires substantial 
commitment and capability. This, in turn, requires deep investment 
which can be achieved only through deep personal involvement in the 
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processes of that change. OLN intended to achieve not only change 
for the moment — the duration of the funded project — but change 
that would be lasting and self-renewing. This report attempts to 
datail the intent, the method and the short-range outcomes of the 
project to provide a permanent account of the project and to 
encourage others to consider the possible applications of this 
model for similar purposes. 

BACKGROUND 

The what and how of the original proposal, and of the project, 
evolved from several forces which came together at the 1970 fall 
convention of the New England Library Association. Those forces 
were: the deep and continuing interest in outreach librarianship 
by several participants from an institute held that September 
("Reaching the Unreached", Springfield, Massachusetts); substantial 
interest and indication of need from many librarians who did not 
attend that institute but wanted opportunities similar to what 
they had heard of Springfield; the interest and willingness of the 
faculty team from that institute, Lawrence Allen and Barbara Conroy, 
to explore ways to respond to the expressed and felt need for 
opportunities to learn the concepts and techniques of outreach 
librarianship. These factors lead Allen and Conroy to generate a 
proposal which was sent to the State Librarian of each New England 
state for reaction and comment before being submitted to the 
Bureau of Libraries and Educational Technology of the Office of 
Education (OE) for consideration for funding as an Institute in 
Training for Librarianship. 

Upon receipt of the grant in June, 1971, a two-month period 



(July-August) served to develop the plan of operation for iniplement. 
ing the project. An initial tentative plan of operation, which 
incorporated the elements of the proposal and revisions suggested by 
the Office of Education, was sent to officials of all New England 
state library agencies, the state and regional library associations, 
state and regional trustee associations, participants froni two 
previous outreach institutes in New England (Springfield College. 
Springfield. Mass. and Bates College. Maine), library media, major 
public libraries in the region and other individuals who had 
indicated interest. The final plan of operation incorporated the 
substantive and procedural suggestions from these various source 
received through correspondence, telephone and personal contact and 
was sent to the Office of Education. August 31. 1971. 
Implementation began immediately. 

NEED 

The premises on which the development of this project were 
based include some of the present conditions which challenge public 
librarianship today in our society, it is these challenges which the- 
project hac-. within its range of influence and effectiveness, 
attempted to address and. in some instances, to offer a model for 
change which can be applied elsewhere. These issues illustrate the 
basic professional concerns reported in the professional- literature 
and featured as focal points at professional conferences. These ' 
premises are briefly stated here to point up the needs to which the 
project sought to respond by its program of activities. 

The survival of the public library, as such, is presently in 
jeopardy. As a social institution, its function is to provide for 
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the informational needs within its community. Presently it is often 
found wanting in meeting this function. As a service agency, it is 
responsible to its clients. In the most dormant instances its 
performance of this function is being ignored or bypassed. In the 
most alive instances, libraries and librarians are being asked to 
look to new roles and new patterns of service in that coimunity. 

In theory, the library's clients include the entire spectrum of 
individuals and groups in the community. In actual practice, however, 
■utilization of library services is often selective due to the method 
by which library services are delivered or due to the lack of 
community awareness of or responsiveness to the services offered. 
Thus, both implicitly and explicitly, the needs of some segments of 
the community are better served than others. Whatever the reasons, 
inequity of service is the result. All communities have overlooked, 
unserved citizens. Those most often unserved by libraries include the 
disadvantaged, the aged, the nonliterate, the minority groups, the 
-institutionalized — all disadvantaged even further because of lack of 
adequate informational services. 

The access to information, having it and using it, is a strong 
element of power for individuals and groups of people in a comnunity. 
The realization that having information is vital to what people want 
and need to do is a growing one. That realization translates into 
alternative means of getting information if public library services 
do not meet those needs. Some of the current alternatives include 
hotlines, government information centers, business references services, etc. 

However they get it, citizens need information with which to make 
decisions in meeting their personal, career and civic responsibilities. 
Current trends which are leading to greater personal development, 
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participative management and citizen-oriented government make the 
individual's decisions ever more significant and the need for access to 
and use of information greater. The growing demand for participation 
in the decision-making on community issues is becoming ever stronger. 
Thus, these pressures promise to intensify rather than to lessen. 
They, the pressures, also promise to be reflected in the demand for 
accountability expressed by the citizen who is asking for evidence that 
shows that important and useful services are actually being exchanged 
for the tax dollar. Active programs of providing information in 
response to community needs by public libraries are one means to meet 
the demand for accountability in the changing society. 

Outreach librarianship seeks to extend library service beyond 
the traditional patterns and through the traditional barriers by using 
new methods, new media, new strategies — or the old ones in nc-w vtays. 
Most fundamentally, successful outreach library programs are done by 
the librarian with the community not by the librarian for the comnunity. 
In this changing world, librarians need to develop the necessary 
abilities and attitudes for outreach librarianship. Libraries need to 
build policies and programs which are closely relat&d to community needs 
and which incorporate community involvement in new ws^ys. The coimunity 
needs to change in relation to the library by actively being involved 
in the planning and use of library services. The initiative for outreach 
library programming can come from any of these elements but it will need 
all these elements in order to succeed. 

The librarian is the key element to effective library service. The 
librarian determines what the library is and is not able to do in the 
community. In many cases, the public librarian is not adequately 
prepared through traditional professional education and inservice 



training for developiRg extended library services to reach out effectively 
in the community. By their own definition, many librarians state that 
they are inadequately prepared with the know-how, skills and attitudes 
that are crucial to plan and implement creative new programs which 
effectively reach the community. 

In general, previous institute experiences of the proposers of 
this prviject have shown that: 1) librarians do not characteristically 
plan effectively with their communities, especially those community 
segments most needful of services, 2) librarians do not elicit 
understanding and support for outreach attempts from the library staff 
and from library boards and other community groups, and 3) librarians 
do not feel competent in assuming new and changing roles in their 
community, these earlier experiences have been confirmed during the 
OLN project and have been recently validated by others working with 
outreach librarianship. These re-affirmed findings are important 
challenges facing those librarians trying to serve a changing world. 

Libraries are being challenged by direct and confronting contact 
with community segments which earlier were not strongly considered in 
planning services. The traditional institutional service patterns need 
to be changed if the interested outreach librarian who seeks to make 
the library an effective agency in reaching out to the entire 
community will be able to do so. Libraries as institutions need to be 
ready and responsive to the rapidly changing world. 

Librarians and libraries can be (and in some cases, are) agents of 
planned social change in their communities. They can facilitate planned 
change in a community by employing creative and useful means of 
distributing information resources, by broadening the potential of the 
Q library as a community facility and by exercising community initiative and 
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suppor-i through personal and institutional actions. Moving from 
traditional to outreach service patterns requires change and under- 
standing of change for the individual and for the library. Initiating 
that shift and sustaining it means working through the ever-lasting 
process of growth which is change. Constructive evolutionary growth 
comes from responsible individuals and institutions responding to 
the issues presented by their environment. An important capability 
for a lasting institution, as well as for a healthy individual, is 
the ability to change — to plan for change and to accommodate changes 
that occur, rather than be bypassed or destroyed by the impact of 
those changes. 

project'assumptions 

These are the premises upon which the objectives and activities 
of the Outreach Leadership Network were based. They provided the 
starting point for the initiation and development of the project. As 
premises, they have become clarified and reinforced with our 
experience of seeing the project unfold over the past several months. 
These premises are the basic "why's" for the project. More briefly 
and specifically, the assumptions on which the various project 
activities are b«sed will be helpful in understanding the "what's" 
of the project. 

The project developers, based on their experiences, assumed that: 

1. Sufficient and valid self-interest would exist on the part of: 

-librarians who wanted to increase the library's outreach 
capabilities within the community, 

-state agencies which wanted to improve library service in their 
states and to provide for continuing education opportunities 
directed toward better library service, 
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-library administrators who felt the need for inore staff trained 
for outreach progranming, 

-previous outreach Institute participants who would be interested 
in deepening their own skills and would see the advantages of 
working togetfier toward outreach through group fiction, to be 
receptive enough to the goals of the project and become involved 
either directly or indirectly. - - 

2. The impact of the learning opportunities available in a 
concentrated workshop would be sufficient to provide skills 
development and to reinforce outreach commitment, thus enabling 
participants to return to their communities with increased 
ability and desire to develop library outreach programs. 

3. The methods of participative education which rely on the ability 
of individuals to be self -directed and responsible, would be the 

. most adequa/te means to provide the depth of behavioral and 

attituci'inal change sought and to discover and encourage leadership 
characteristics in librarians as well as being ths methods most 
congruent with arid supportive of the project management style. 

4. Enough existing and potential New England library leadership 
could be brought together through institutes and training programs 
to provide an opportunity for involved and responsible leadership 
to see multiple possibilities offered by regional efforts of 
networking. 

5. Through its own pro-active "outreach" activities, the ad hoc 
and external nature of OLN could provide a solid enough base 

for a sufficient time to stimulate a broader, indigenous base with 
similar aims. 

6. A region of six geographically-contained states having an active 
regional library association and an interstate library compact would 

Q provide adequate opportunities to sustain leadership network 
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activities if OLN could initiate them. 
7. Continuing education with the practioner in the field would 
yield the greatest number of short-range and long-range direct 
results because the educational experieuces can be related to 
real needs and can be applied immediately. 

THEORETICAL FRAMEWORK 

These premises and assumptions provided the rationale for the 
project. The project's goal was to provide an educational program to 
increase the ability of New England librarians in planning and launching 
successful and effective outreach programs. Its objectives were to 
design activities which would encourage more outreach librarianship — 
by helping public librarians in the region develop action plans of 
outreach services and by encouraging the capability and commitment of a 
significant number of public library leadership in continuing the impact 
of the project beyond its funded life. 

To accomplish these objectives, the staff based the major project 
activities solidly within a theoretical framework which brought together 
several interrelated areas of the applied behavioral sciences. How 
project tasks were accomplished was as important as what was accomplished. 
A brief sketch of the project activities will help to provide a context 
within which a description of the theory base underlying those activities 
will be more understandable. These three areas are more fully described 
later in this report. Basically, major staff efforts were: 
1. to establish and maintain an administrative base which could 

assentle and coordinate needed resources. Short-range, this base 

was needed to produce the educational events of the project. 

Long-range, it might be used to provide a base for further 
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development of thenetwork with which the impetus built by the 
project could be continued, 

2. to develop the leadership training program which would provide 
opportunities that would prepare the initial group of librarians 
who would b2 staff menbers in the four institute programs and 
that would build toward an expanded leadership group to include 
institute participants as well as staff who indicated a high 

, degree of leadership potential, 

3. to produce four outreach institute programs which would develop 
the attitude and ability needed, for effective outreach librarian- 
ship in participating New England librarians. 

Resources of the project — staff, funds, materials, facilities 
were directed toward these efforts. 

The immediate and essential task for the staff was to build and 
"maintain a new organization — a "temporary system". The organization 
needed the ability to move quickly enough to make the necessary 
decisions which could produce seven workshops for a total of 166 
participants in an 11-month period. At the same time, it had to be a 
sound example of what its precepts were ~ solidly based in sound theory 
and able to manage the attainment of its objectives within tight time, 
staff and money parameters. Further, the staff built toward an unknown 
future, not knowing if the idea of outreach networking would "take" 
with a substantial enough "critical mass" of individuals to effect 
significant change in New England librarianship. Whether, where and 
how those changes would be made was as impossible to predict as what 
changes might come about as a result of the project's activities. 

The theoretical framework within which the project was set was 
carefully selected in order to be able to provide a model — a model • 
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which could present working concepts for librarians to consider as 
possible options in their own jobs within their own communities. The 
project sought to be an example, within itself, of the principles of 
participatory management and of planned organizational development as 
well as those of educational technology and participative education. 
This model was intended to be relevant for librarians in working with 
their communities and colleagues, for administrators in working with 
their staffs and trustees and for state agency personnel in working 
with their librarian-clients. For some involved in the program 
activities these principles were their usual "style"; for others, 
the model offered a look at a new way of doing things. In either 
case, the project presented an opportunity to consider and practice 
important, basic precepts in education and management. Whatever • 
outcomes this aspect of the project may have achieved can only become 
evident in the future as those who have participated in the program 
attempt to use what they have learned in their personal, professional 
and civic lives. 

The developers of the project, Lawrence Allen and Barbara Conroy, 
hoped to emphasize and demonstrate the practical art of bringing 
together theory in several areas of the behavioral sciences, specifically 
those of participative education, educational technology, participatory 
management and organizational development. Some of the rationale for 
this selection is implicit in the assumptions described on pages 8-10. 
Explicitly, the project was an attempt to test, using this model, some 
controversial directions in education and management which are being 
discussed currently and are being considered by many in the field of 
librarianship. Each of these areas is described here in a capsule 
statement. For more information about each, consult the references 
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mentioned in the "Materials" section of this report on page 41. 

Participative education is learner-centered ~ the learner is 
actively involved in identifying his own needs, in setting his own 
goals and in analyzing his own problems and solving them. He is not 
merely the recipient of information but is an active participant in the 
learning process. The "teacher" is a primary resource, a helper in 
that process. Self-directed learning has been a growing emphasis in 
modern adult education. It has been found to be particularly well 
si'Hed for adults who feel a need for creative continuing education 
opportunities that are directly and lastingly related to themselves as 
individuals and the issues and problems they confront in their lives. 
The importance of this method to this project, in addition to the fact 
that it is the most effective learning method for adults, was that the 
responsibility necessary for the learner to assume can be closely 
linked to the emphasis of the project on the discovery and development 
of leadership. One of the leading characteristics of leadership is the 
assumption of initiative and responsibility. 

Educational technology refers to the application of findings in 
behavioral science to educational and instructional planning and to the 
solution of basic teaching-learning problems. Educational technology is 
concerned with the ingredients, not only the hardware, of education. 
It is a systems approach to education in which behaviorally stated 
objectives form the base for the design of learning opportunities and 
the means for evaluating results during and after the program. The 
importance of this educational method to this project was the need for a 
sound educational approach which carries a high possibility of achieving 
lasting learning results in the important area of leadership development. 

Interest in participatory management as an administrative style is 
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becoming greater in librarianship- due to the attention generated by 
the attractive outcomes that can result - resourceful, productive 
and involved staff working within a flexible and effective organizational 
structure to accomplish the goals. Participatory management rests the 
organizational decision-making process at the level where the most 
adequate information is available and where the greatest effect of those 
decisions will be felt. Its basic work style is that of problem-sol ving 
in small, goal-oriented groups in which the members work collaboratively 

together on the task. Often the fmqtratinnc f<.n- k 

tne Trustrations felt by managers and staff 

in the shift from personal and organizational orientation of a more 
authoritative nature dissuades individuals and organizations from 
attempting it as a management approach. 

Characteristics of this management style are: shared leadership " 
and membership roles, consensual decision-making, maintenance of a 
supportive atmosphere for learning and doing, free flow of cor^unication 
and interaction with a high degree of trust in the ability of individuals 
to make their own best decisions and the structural basis of tea^ working 
toward organizational objectives as well as their individual learning 
goals. The.project emphasized each of these and. as with others trying 
this style of leadership, we encountered resistance due to lock of 
understanding, the entrenchment of habit and the scariness of being 
responsible for one's own behavior and decisions. The importance of 
participatory management within the project was to allow the fullest 
possible use of the human resources available and to provide learning 
at many levels - at the task level in getting the job done, at the 
organizational level in having many people involved at various 
organizational levels and at the level of being involved in the managen^nt 
process itself as an opportunity to learn about the advantages and 
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disadvantages to this style of management. 

The last aspect of the theoretical framework for the program is, 
like the others described above, relatively new to many library 
administrators and is being looked at from afar more often than it is 
being implemented currently. Organizational developrrent is a means for 
planning the processes by which the organization can adjust itself to 
accommodate the changes that may threaten its survival. As such, it is 
the most practical approach to resolving organizational problems; it 
assumes a need to grow and change. People have that need and so do 
organizations. Specific elements of organizational development working 
with people within the organization toward a mutual goal by means of 
objectives jointly agreed upon. Direct and opsn communication, 
collaborative mathods of working together and a broad basis for decision- 
making — these bases are necessary to build and maintain a healthy and 
attitudinally mature organization. 

The short duration of this funded project might have indicated that 
strong consideration of organizational development was neither desirable 
nor feasible. However, the project was intended to be a catalyst for 
the creation of a network of outreach librarians. As an initiating agent, 
some of the concepts within the project might be carried into future 
network possibilities. State or regional networks would have to have the 
ability to adjust to changing needs of librarians and their communities. 
Thus, organizational development methods deliberately used within the 
projact might prove to be a desirable future base as well as to offer 
the project itself, during its life, the advantages which come from a 
sound and flexible organizational base. 

The reasons for this project being rooted within this theoretical 
Q framework which included parti ci pati ve education, educational technology, 
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participatory management and organizational development was not so 
much to test the validity of the principles but to apply them within 
this temporary system of continuing education. Primarily, however, 
these precepts were used with the intent of giving all- the individuals, • 
libraries and agencies involved in the program, or observing it, a 
view of the benefits and difficulties of putting these theories into 
practice. In a very real way, the project served as a preparation of 
individuals and library organizations for the future, prompted by the 
prospect that "...libraries will be organized differently in the not 
too distant future. And one of the reasons will be the continuing 
influence and application of the behavioral science methods and 
techniques in management -- a human relations approach that clearly 
places the emphasis on human understanding, group organization, the 
responsibility of management to the worker, and fluid, task-oriented 
organizational structures."* 

The three principal project activities — establishing an administrative 
base, developing the leadership training program, producing outreach 
institute programs are what the project did. The theory-based 
principles described above are vjh^ and how those activities were done. 
Within the next section, each of the three major activities will be 
described in sufficient detail to give a clear picture of what happened 
during the existence of the Outreach Leadership Network. 

*(Surace, Cecily J. The Human Side of Libraries . ED 025297 ERIC 
January, 1969.) 



PLAN OF OPERATION 

Understanding this theoretical framework of the project, the 
specifics of what happened and how during the life of the Outreach 
Leadership Network may be more fully understood. Each of the 
project activities had multiple purposes, multiple points, of impact 
and substantial interrelationship with one another, ^or clarity, 
however, they are described here separately and within the context 
of the three major efforts outlined on pages 10-11 -- establishing an 
administrative base, developing a leadership training program and 
producing outreach institutes. 

To illustrate the structural relationships among the various 
project components as an aid to understanding the following description 
of the Outreach Leadership Network, Figure 1 presents its basic 
organizational structure. Names of the individuals in each group 
are given in Appendix D. . 




Figure 1 

Organizational Components of the Outreach Leadership Network 
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The following detail of the actual plan of operation as it was 
implemented will describe each Of these components. This description 
will cover the administrative base of the project, the Leadership 
Training Program and the Outreach Institutes, together with outlines 
of staffing responsibilities and materials used in the project 
efforts. An overall schema of all project activities appears as 
Figure 2 on page 19. 
Administrative Base 

Even though OLN-was intended as a temporary system, the requirements 
for basic organizational components were the same as for any system to 
do its task. First, it needed facilities and personnel. The necessary 
physical facilities were provided by the New England Center for 
Continuing Education at the University of New Hampshire in Durham. 
The project was affiliated with the Center thoughout the entire funding 
period. Initial core staffing which continued thoughout the project 
consisted of a team including a project director, a project assistant/ 
secretary, a half-time project coordinator and a project consultant. 
(See staff roster in Appendix D ). This team had to be able to 
coordinati,; their efforts effectively on all aspects of the project 
since many activities happened in quick succession, sometimes simul- 
taneously. Additional support staff had to be added during periods of 
peak activity. Details of the responsibilities of all staff will be 
outlines later in this report. 

Following establishment of the initial headquarters, basic policies 
and procedures were needed. Vital to connect the precepts and the 
practice of the project were policies and procedures which would assure 
an atmosphere that fostered open communication and responsible and 
collaborative decision-making. The headquarters staff developed 
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initial outlines of who does what, when, and how. These were tentatively 
set and, as other project components evolved, the initial policies, 
procedures and planning were modified. Major sources of modification 
included the following: a) suggestions and reactions to the tentative 
plan of operation were useful in prompting some initial patterns for 
policies; b) recommendations from the Network Advisory Committee at 
their initial and mid-point meetings helped set directions for project 
activities; c) the initial training session in October 1971, together 
with subsequent staff meetings involving field staff, served to 
clarify the roles and responsibilities, to plan what was to be done and 
how best to do that; d) program development meetings, held throughout 
the project evolved both general' and specific policies and procedures, 
and e)feedback provided throughout the project from the Evaluation Team 
provided substantial impact on the programs. In short, those individ- 
uals and groups involved in the project had a large share of responsibility / 
for forming its organizational policies. 

Viable and effective means of communication is a prime need for any 
organization. The complex structure of this project, together with the 
physical distance that separated its components and the need for quick 
activation made communication a challenge. The cotibination of six states 
and seven teams posed multiple dilemmas. Each team had a need for prompt . 
and adequate information upon which to make and implement the many 
decisions for which it was responsible. The means and methods devised 
for project communications could, at the same time, provide a model for 
future networking possibilities. 

The most regular medium developed to share information within the 
project was the Network News Notes whirh was edited by the Project 
Assistant/Secretary. Begun in November, 1971, its six issues were 
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distributed to all field staff members, the Evaluation Team and the 
Network Advisory Committee. This newsletter included schedules of all 
project activities and information about policies and procedures as 
they evolved. It also provided a means to elicit feedback from the 
staff and to share training information and the ideas and experiences 
from the various institute programs and staff meetings. In addition 
to producing this newsletter, the telephone and correspondence workloads 
on the office staff were heavy in an attempt to initiate and maintain 
communication flow. 

The need for extensive communications to meet the needs of those 
within the project was great. There was^ also a substantial need to 
inform others of the nature and activities of the project. One result 
from the second Network Advisory Committee meeting, together with the 
Interest of some of the intern assistants in continuing their activities 

i 

with the project after completing their institute responsibilities, 
a Communications Team was formed. It proposed to develop written action 
plans to enable OLN to communicate with outside groups in order to 
encourage their action and/or awareness of outreach. To do this, they 
established priority groups (librarians, trustees, state agencies, 
library media, etc.) and recommended a plan of action for each group to 
the OLN headquarters staff for implementation. In addition, they made 
plans to evaluate those action plans and to expand the team by incorp- 
orating other interested staff. The OLN office was responsible for 
implementing these action plans as timing seemed feasible and appropriate. 
This team reveals the nature of shared responsibilities within the project. 
The initiative came from a sense of personal and organizational need, 
and the response of doing something about that need was shared by the 
initiators and the headquarters staff. 
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Similar to the shared" responsibilities for the communications 
function was responsibility for decision-making. Each team was 
responsible for decisions relating to the responsibilities they had 
assumed. Since teams were the basis for decfsion-making, team-building 
activities were necessary to help those teans learn to work together 
at the saiiie time they worked toward fulfilling their responsibilities. 
Headquarters staff worked closely with each team, but major decisions 
were jointly made. Since quality decisions rely on the amount of 
information available and used in the process of deciding, the 
communication function of the project was doubly important. Network 
N^^s Notes proved helpful in addition to other materials supplied by 
the project. These materials are described later in this section. 
Personal contact among staff members with each other and with the OLN 
office by correspondence and phone was encouraged. 

One of the major means of facilitating communications and decision- 
making within the project was the "documentation form". Prompted by 
the need of the Evaluation Team for information upon which to evaluate 
the project and at their suggestion, a documentation form was designed 
to record all project events. For each team meeting, a documentation 
record of the meeting's content and process was required. Field staff 
members were responsible for documenting OLN meetings and workshop 
sessions. This record was then distributed to staff and meeting 
attendees. It reported necessary information to those needing to know, 
provided the opportunity of forming agenda for subsequent nieetings and 
following through on all points covered by the meeting and the assign- 
ment of responsibilities. This record of developments of the many 
evolving activities was invaluable as a briefing tool for staff in 
preparation for picking up the continuity of a particular activity. 

O -11 - 

ERIC 



In addition, it served as a major training tool to incre?«e staff 
awareness and ability in analyzing group dynamics. .Copies of document- 
ation forms for meetings and workshop sessions are in Appendix H. 

An additional and important element of the administrative base was 
the outside Evaluation Team. This team consisted of three individuals — 
a library networking expert, an educational technologist and an expert 
in adult educational methodology. (See staff roster in Appendix D ). 
The team was charged to supply program feedback about activities in 
process and to provide overall evaluation of results at the end of the 
project. Although autonomous to the project, it needed to receive 
information from various components of the project and to furnish 
feedback to those components. The report of the Evaluation Team is 
available as part two of this final report where its rationale, 
methodology "and findings are detailed. 

Essential to the direction and the nature of this regional project 
was the Network Advisory Committee. Meetings and regular reports to and 
from members of thvs body sought to provide information about project 
activities and outcomes to assure rc-gion-wide program integration and to 
suggest ways that local and state-wide programs might link with the 
project activities for mutual benefit and increased impact. Mentership 
on the coimittee included: each New England State Librarian (or designee), 
the OE regional library services program officer, two representative 
intern assistants and two representative state coordinators, the Director 
of the New England Center, the Evaluation Team and the project staff. 
(Roster in Appendix D). 

The initial meeting of the Network Advisory Committee, September, 1971, 
suggested the needs of the New England region for outnaach programming and 
the needs of the public librarians for training in outreach. In addition, 
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. they developed the overall criteria used in selecting menters for the four 
institute planning meetings. The Committee's second meeting, February, 
1972, reviewed the project activities, examined the" organizational needs 
for a conuiuni cations plan and considered the evaluation plan for the 
project. The third and final meeting reviewed all the project activities, 
outcomes and implications for outreach librarianship in New England, 
and heard reports of the current findings of the Evaluation Team and the 
evolution of two efforts attempting to extend the activities of the project. 

Establishing this administrative base was necessary in order to manage 
the multiple project activities directed toward the accomplishment of project 
objectives: 1) developing the ability of public librarians to formulate 
and implement action programs of library outreach" and 2) developing a core 
of library leadership able to evolve a network which could continue the 
impetus of the project. In order to achieve the second of these 
objectives, another major focus of OLN activities was the development of 
a leadership development program. 
The Leadership Development Program 

Through a combination of learning opportunities in sequence, the 
projectjsought to prepare two regional cadres* of leaders committed in 
attitude and action to outreach librarianship. Figure 2 shows this 
sequence in outline form. The first cadre was intended to become staff 
members for four outreach institute programs to be conducted by OLN in 
early 1972 for New England public librarians. Tf-.e second cadre would 
blend the key leadership potential of those in the first cadre together 
with leadership potential discovered in the institute programs. This 
core group would reveal the existing potential for developing a regional 
outreach network. 

*cadre - a nucleus, especially of- trained personnel, capable of 
O . assuming- coat rol and training others. Merriam-Webster, 1971. 
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The educational activities of the project -- i.e. OLN outreach 
institute programs - required three kinds of staff - professional 
faculty, assistance in performing training functions and an administrative 
staff. The first cadre known as field staff, consisted of the latter 
two groups working closely with the faculty. The assistants performing 
training functions with the institute programs were designated "intern 
assistants". Administrative staff members were designated "coordinators" 
Each of the four institutes were staffed by a- team composed of intern 
assistants and state coordinator(s) . A roster of intern assistants and 
state coordinators is included in Appendix D. 

Intern assistants for the OLN field staff were selected on the basis 
of an assessment of interest in this opportunity and availability for 
the commitments necessary. Participants of two previous outreach 
institute programs done in New England by Allen and Conroy were eligible. 
Additional criteria used in selecting these individuals included: 
continued involvement in outreach since the earlier institute experience 
(in libraries, in communities or in professional associations); under- 
standing, acceptance and commitnent to outreach; evidenced leadership 
skills; potential for initiating further outreach efforts; geographic 
distribution; and interest now in working together to further their own 
abilities and to outreach to their colleagues in the profession by 
helping other librarians develop action programs of outreach services. 
Each of these individuals would continue their regular employment and 
responsibilities but would take on an estimated three weeks of 
responsibilities as an OLN field staff menter. 

The project was originally budgeted for twelve "intern assistants", 
but correspondence and personal contact served to bring together a group 
of 15 individuals for a two-day training program in October. 1971. 
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Of these fifteen, twelve completed an average of three-weeks work as 
intern assistants— the original conmltnient for planning, the workshop 
and follow-up activities included in each institute program* For these 
responsibilities, intern assistants received $25 per de^y, plus travel 
and living expenses for meetings and workshops. Three individuals were 
prevented by library and personal aniergencies from full involvement as 
workshop staff members but all were involved in pre-workshop planning. 
One of these three was fully involved in all other active aspects of 
the project except the workshop. 

The Outreach Institute was the team's "action program" of outreach 
done cooperatively. For intern assistants, the Leadership Training 
Program concentrated on the ability to work helpfully with groups, to 
design educational workshops and to communicate effectively the 
principles of program planning. The sequence of learning experiences 
also offered repeated opportunities to deepen their own program planning 
and consultation capabilities and to develop skills of communications and 
leadership ~ and the chance to extend their outreach efforts to 
colleagues within their own professional field. Intern assistants needed 
to be prepared to assume training and consultative responsibilities 
during and after the workshops. The professional faculty served as 
"back-up" and as tutors in addition to instructional responsibilities. 

Coordinators from each New England state were planned to be the chief 
in-state contact point for the GLN project activities in that state and 
to serve as a liaison to link state agency and OLN activities when these 
were congruent and relevant. Each State Librarian was asked to select 
from the state agency staff an individual who now had or would subsequently 
have the responsibility for programming continuing education activities. 
^ Involvement in the project as state coordinator offered the opportunity 



for learning the skills needed for conference administration and program 
planning. For those inexperienced in conference management techniques, 
the project coordinator served as a professional "back-up". The time and 
support staff needed by the state coordinator were contributed by the 
state agency, although the project funded travel and per diem for 
coordinators while on project business. 

The functions of the state coordinator included the administrative 
and coordinative aspects of the institute programs. In addition, their 
expertise was anticipated regarding the needs and resources of the state 
and knowledge of state agency plans and needs which might fit with ths 
project goals and activities. Beyond these responsibilities, those 
functions performed by the intern assistants were optional for the state 
coordinators. Intern assistant functions could be selected by a state 
coordinator who wished deeper involvement in the program. Three of the 
six appointed had earlier participated in outreach institutes. 

To prepar-a these twenty-one people for their roles as intern 
assistants and state coordinators, the following training sequence was 
established: 

1. a two-day training program, October, 1971, 

2. planning for and participating as a staff team in a one-day 
planning meeting designed to assess needs of the areas from 
which participants for that institute would come, 

3. a series of team meetings with the faculty prior .to the 
workshop to assess needs, to develop institute objectives, 
to plan institute design, and to prepare for assigned staff 
responsibilities during the workshop, 

.4. assigned staff roles during the workshop experience with 
responsibilities for responding to the needs of the program 
and its participants. 



5. participation in follow-up activities after the workshop. 

In addition to this program of events, "tutorial" consultation of 
headquarters staff, including the Project Consultant, was available via 
correspondence, telephone and personal contact. Allen and Conroy were 
called upon frequently to respond to the needs of teams and individuals. 

The October Staff Training Program intended to prepare intern 
assistants and state coordinators for assuming their responsibilities 
before, during and after institute programs, to select four staff teams 
and to begin to develop inter- and intra-team relationships in preparation 
for the work ahead. The program served to begin to define intern 
assistant and state coordinator roles by taking into account the 
organizational needs of the project and the personal goals and resources 
of the individuals involved. Teams were selected, which brought together 
out-of-state intern assistants for each institute team. Additional 
criteria for team selection included: feasible scheduling, a balance of 
skills and compatible individual learning'goals . 

The training program was coordinated by Cynthia Giesing, Project 
Assistant/Secretary; Lawrence Allen and Barbara Conroy served as faculty 
members, joined by Margaret Soper, Project Coordinator who worked with the 
state coordinators. Members of the Evaluation Team were observers. Thus, 
the initial training program served to begin field staff working relation- 
ships with the full-time faculty members and the headquarters staff. 

Each institute staff team, working together with faculty and head 
quarters staff, met several times prior to the workshop. These meetings 
served to clarify team roles and responsibilities, to design the 
educational program and to work out team working relationships, to unify 
the team around the objectives for the institute program, to draw together 
the resources within the team, and to support and prepare the staff 



ERIC 



menters for the workshop. Each staff meeting provided an opportunity to 
develop documentation skills and to share perceptions of the meeting's 
dynamics at the end of the day. Thus, these meetings served not only to 
work on the task at hand -- producing an institute - but also to present 
the team with a learning experience in building staff awareness and 
skills in working with a group on a common task. 

The Leadership Training Program in August, 1972, brought together 
thirty-two individuals from six states for a four-day program focused on 
leadership skills development. This program was 6pen to staff and 
participants of the outreach institutes. Participants from the earlier 
Bates and Springfield outreach institutes were also invited on a "space 
available" basis. As specified in the original proposal, this program 
was planned to build on the leadership skills and personal and professional 
commitment to outreach concepts discovered during the Outreach Institutes. 

Planning for this program was done by a representative .group of 
potential participants and staff members. They established the criteria 
for participant selection, scheduling, staff and training focus for the 
pr-ogram.. The criteria included: interest and availability for the period 
indicated, .commitment to outreach, evidenced potential leadership skills, 
and geographic distribution. The training staff selected for the program 
were Joseph Arceri and Diana Forsyth, both of whom had worked with 
previous OLN institute staffs. They knew the intents of the project and 
the aims of the training program as well as many of the individual librarians 
involved. The nature of the program included emphasis on leadership 
styles, value clarification, self-assessment and building the skills 
necessary to work effectively within a task- group and together with other 
such groups. 

In September, interested field staff members, and Outreach Institute 
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participants, some of whom had been involved in the August Leadership 
Training Program gather-eu for a two-day Fol low-Up Workshop for Outreach 
Leadership. At this workshop, the participants took the initiative and 
responsibility for exploring ways to continue the impetus of the Outreach 
Leadership Network activities. Allen and Conroy served as resource staff 
during the two days, but the management and outcomes of the workshop 
belonged to the participants* 

The outcomes of this Fol low-Up Workshop on Outreach Leadership were 
highly significant. Two compatible endeavors were developed. One, a 
Steering Committee would seek to evolve a structure that could continue 
the necessary functions needed for such an organizational effort; two, 
a Task Force for an Outreach Information Clearinghouse would attempt to 
compile an OLN Directory of Outreach Projects as an important and 
immediate step while the Steering Committee laid more long-range plans. 
Since that time (September, 1972), work has continued on the Directory 
and the Steering Committee .merged with the Continuing Education Committee 
of the Regional Planning Committee of the New England Library Association 
to petition to become a section of NELA called New England Outreach Network. 

These two major efforts do not comprise the sole significance of the 
Follow-Up Workshop. The two outcomes described above were realistic, 
important and valid. Similarly, the way the group worked together also 
revealed solid outcomes from the entire project's activities. Although 
all members of the group had been involved in OLN activities, many had not 
worked together before. However, they were able to come together and, 
in a short time, contribute their commitment and capabilities in the 
cooperative effort they sought. The total initiative and responsibility 
taken by the participants was very important. They developed their 
O objectives based on what they felt needed to be done. Then, they developed 
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an action plan to accomplish those objectives. Their basic precepts were 
strongly expressed and included the importance of involving as many New 
England librarians as were interested in this effort. 
The Outreaeh Institute Programs 

The third major area of project activities is the most tangible and, 
in many ways, the easiest to describe concretely. Each of the four Outreach 
Institute programs consisted of preliminary activities, a workshop and 
follow-up activities and was designed to help librarians develop the 
attitudes and abilities needed for effective outreach librarianship. The 
institute program was the "action plan" of the staff team — its planning, 
implementation and evaluation were "outreach" directed toward .librarians 
by the staff team. The institute program served to reinforce the skills of 
the institute staff team in implementing and evaluating an action plan. 
Thus, the institute program itself was a macrocosm of each participant's 
action plan, serving as a model for each participant to examine as it was 
lived and in relation to the action plan he/she was making for application 
in the' back -home community. 

Details about the locations, dates, participants and staff are shown 
in Figure 4 and detailed explanation of staffing resoonsibilities and 
materials used in the institute programs are reserved for later in this 
section of the report. The following were constants for each Outreach 
Institute Program: 

-Prior to each institute, a planning meeting brought together 20-30 
librarians and community people to meet with the staff team responsible 
for that institute. Members of this group were representative of 
libraries within the area, library educators,- trustees and client/ 
community people selected by the State Coordinator and the Project 
Director with the consultation of the Intern Assistants from that state. 
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These meetings served to assess the needs of the stata(s) and the 
librarians there. It established a basic direction and focus to the 
content of the institute program to be held. These planning meetings 
also established the criteria and procedure used to locate and select 
the librarians invited to participate in the program. Planning 
meetings offered the opportunity of integrating OLN activities with 
other state and community programs working toward congruent goals. 
-The institute staff team (faculty, intern assistants and state 
coordinator) subsequently met several times to develop specific 
institute objectives based on the needs described by the planning 
meeting and to plan, as a group, the educational activities, staff 
and scheduling needed to accomplish the established objectives. 
-Various means were used to locate and select participants for each 
institute. In all but one case, those means included a complete 
mailing to all libraries in the state to discover librarians interested 
in this opportunity. For those indicating their interest and avail- 
ability, other criteria were later applied. General project criteria 
which were applied for all four institute programs included: interest 
and/or responsibility in one or more libraries or agencies; influence 
and/or authority to be able to anticipate actual endorsement of outreach 
planning in their library or agency; willingness to involve themselves 
in the preliminary stages, the full time workshop and the follow-up 
activities; and library training or experience necessary to provide a 
common context for a learning experience. Additional criteria were 
added by the various planning meetings for application in their 
particular state(s). Based on these criteria, selection was done by 
staff members from that state with final responsibility for selection 
resting with the Project Director. 
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-The OLN office assemble'd resources requested by the institute 
staff team for the program — contracted for the facilities in 
cooperation with the state coordinator, prepared worksheets and 
handout materials, located and contracted for additional faculty 
as needed,did necessary mailings, assembled on-site libraries for 
participants and staff, etc. 

-Each participant received materials in preparation for the workshop 
experience itself. These materials included details about the 
logistics of living at the workshop, as well as help for developing 
an action plan. More details are given later in this section. 
-Each participant received preliminary activities which wore designed 
to broaden awareness of the librarian of the coimunity needs and 
attitudes (including that of the library staff) and to gather 
coimunity data he/she would use in developing his/her action plan at 
the workshop. 

-The overall focus of the workshop was on developing the ability of 
public librarians to formulate and implement community-based action 
programs of library outreach. The institute staff team sought to 
provide a series of concentrated learning experiences in areas 
necessary to do this. Although the educational design of each 
workshop varied, the core curriculum in each case included: 
-awareness, of coimunity needs and resources, and the role of the 
library in the community, 

-a step-by-step, problem-solving model of action planning, 
-the concepts and strategy for planning and effecting change, 
-human skills and insights: leadership, interpersonal and group, 
helping relationship, etc., 
-planning for evaluation of action programs. 



Each workshop dc^y was balanced between action planning and building 
personal and r/roun skills that would be necessary to implement that 
planning. However, each emphasis was reinforced by strong linkage 
and application with the other area. Each participant was helped to 
define his own commitment and translate that into an outreach action 
program. Participants in each workshop received a stipend of $15 
per da,y plus a dependency allowance of $3 per dc^y where applicable. 
Three of the 113 participants left t-\e workshop early due to personal 
reasons. During the workshop, the faculty sought to offer opportun- 
ities for the intern assistants to demonstrate and practice their 
leadership and helping skills, to deepen their outreach coimitment 
and to understand thoroughly the principles of applied program 
planning. 

-On the last day of each workshop, the participants, as a group, 
planned the initial direction of their follow-up activities. These 
were different in each state — planned around different needs, 
different interests, etc. Like the Follow-Up Workshop for the Leader- 
ship Training Program, the planning of institute follow-up activities 
signaled the transfer of the initiation of activities from OLN to the 
participants themselves. At this point, OLN -became the responder, 
supplying the necessary resources (staff, mailings, materials, etc.) 
to support what the participants felt they needed and wanted to do. 
In general, an initial follow-up meeting was planned for some weeks 
after the workshop. The ensuing time was to allow needs to surface 
from the participants as they returned home and began to implement 
their outreach action plans. 
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These were the constants for each of the Outreach Institute Programs. 
Each program had its variables in preliminary activities, content and 
design of the workshop, staffing patterns, etc. This report is not 
Intended to specifically detail those. However, the variations in the 
follow-up activities is significant since it reveals local initiative. 
Some of the variants included: two instances of outreach committees 
affiliated with state library associations — in each case, stressing 
the advantage of including many more librarians than just those who 
attended the institute; outreach education efforts directed toward 
trustees; planned utilization of other continuing education and action- 
oriented opportunities offered by outreach groups; evaluation consider- 
ations for action plans. One state formulated group objectives and an 
action plan to include the involvement and contact of participants from 
other states who had been OLN participants. 

This review of the three major areas of activity of the Outreach 
Leadership Network shows, to some extent, how those areas interacted 
with each other in many ways. The efforts to establish an administrative 
base, and to develop a Leadership Development Program and the Outreach 
Institute Programs have been described generally. Two important aspects 
have biien reserved for more comprehensive detail here. These two aspects — 
staffing and materials — are vital to any organization, especially one 
like OLN which relied heavily on people and information. The OLN attempt 
at networking needed to rely directly on both people and infoniiation to 
accomplish its objectives. It also sought to be a model and to provide 
its own experiences as a means to show staff and participants useful we^ys 
in which regional networking might be done. 



staffing 

The staffing requirements of this complex project were diverse and 
complicated. A wide variety of talented and knowledgeable human resources 
was needed not only for the term of the project activities but for the 
future. This required the team approach which was selected and used 
throughout the project. Each team brought together knowledge, skills, 
experiences and insights greater than any one person could have. The 
various teams described above -- the headquarters staff team, four 
institute staff teams, the evaluation team and the communications team — 
brought together individuals who worked on a common task and shared 
responsibility and accountability. 

The headquarters staff team was responsible for maintaining the OLN 
administrative base by doing what was necessary to provide a central 
contact point for needed information, to enable the -'nstitute staff teams 
to plan and conduct their outreach institute, and to assure overall 
program direction, coordination and implementation of the entire program. 
To fulfill this team responsibility, the Director was responsible for the 
selection and direction of staff responsible for necessary project 
functions, for selection of faculty and resources for outreach institutes 
and training programs, for assuring that the funding intent of OE was 
being fulfilled and for reporting to the various bodies to which the 
project was accountable. The Project Assistant/Secretary was responsible 
for maintaining office procedures, files, correspondence and contacts 
with all project activities and for editing the Network News Notes . 
These individuals worked full time with the project. The part-tiire Project 
Coordinator was responsible for coordination of necessary administrative 
procedures for the project and the files and records to meet institutional 
requirements. In addition, she served in a consultant capacity with the 
state coordinators. The Project Consultant served as a sounding board 

for many issues and concerns, was a valuable auxiliary contact point, 
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helped formulate policies and procedures and was a reserve staff menfcer 
where needed. Both he and the Director performed administrative tasks 
with the project in addition to serving as full-time faculty for each 
Outreach Institute and the Staff Training Program, and in a consultant 
and tutorial capacity with each intern assistant individually and the 
team as a group. , • 

Each institute team consisted of intern assistants and a state 
coordinator working with the full-time faculty. It was responsible for 
planning, implementing and evaluating an institute program. Team menters 
were responsible for meeting and making the necessary decisions regarding 
participants, staff responsibilities, materials and facilities as well 
as the educational design for the workshop. Intern assistants were 
responsible for the educational functions, primarily supplementing the 
faculty in helping participants evolve their action plans. They were 
uniquely helpful to this process because of their own direct outreaching 
efforts in their own' libraries. The state coordinator was responsible 
for the administrative needs of the program ~ logistics, facilities, 
communications for the participants and as a resource person to the staff 
team regarding the nature of the state, the state agency, the needs for 
outreach, state funding possibilities, etc. Each institute staff team 
assigned its responsibilities in such a way that they could take- account 
of the learning goals, .interests and skills of the team as well as the 
particular institute with which they would be working. The team was 
responsible for looking at what there was to do and deciding how they 
wished to work together in getting those tasks done. • < 

For all but the first Outreach Institute, a resource team was 
assembled to provide learning sessions on community, communications and 
^ cooperation in each of the '..'irkshops. These teams worked together with 
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the regular institute team, including the regular faculty, in planning 
their sessions, although they were responsible for conducting them. 
These sessions offered the opportunity for the institute staff team to 
work toward its own learning goals and to assist participants from 
another perspective than was offered during the other sessions. 

The Evaluation Team has described in detail their responsibilities 
in their own report which is a part of this document. These three 
outside evaluators were responsible for the design and implementation of 
an evaluation plan to measure the effect of the Outreach Institutes and 
the Training Programs. With the assistance of a data analyst, they 
provided program feedback and results evaluation through their own 
observation and through evaluation instruments. 

The Communications Team formed from the interest of intern assistants 
following the institute in which they had been involved. The strong 
organizational need for communicating with the "outside world" was felt 
by OLN and this team developed action plans for initiating and sustaining 
those contacts. Implementation of the action plans was the responsibility 
of the OLN headquarters staff. This team became the subsequent focus, 
after the institute series was concluded, of the staff meetings in July 
and August which looked ahead at the continuation of the thrust of the project. 

Each of these teams was subsidized somewhat for its endeavors. 
However, each gave a tremendous contribution of time and talents to the 
project. Although it would be a help for those looking at this as a 
model, we have not presented a budget which would show the costs of the 
project. So much time, as* well as facilities and resources, was' 
contributed by the headquarters staff, the field staff, the state agencies, 
the evaluation team and the participants, that it is impossible to 
^ calculate the costs with any element of reality. 
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M aterials 

Relevant materials were needed by each staff group connected with 
the project. Information relating to organizational responsibilities 
and the distribution of that information are vital considerations for 
aiiy organization. In the OLNj the headquarters staff needed basic tools 
to develop the model and to help staff teams with their learning. The 
Training Program and Outreach Institute participants needed materials 
that would be helpful during their workshop experience and which would 
be equally useful as they applied those learnings back-home. The 
Network Advisory Committee needed up-to-date information about the 
activities of the project. Materials had to be developed which would 
inform groups unaware of the project about it and its activities. These 
uses demanded different types of materials. Each of these categories 
is desc-ibed here in case they might be helpful in considering application 
of this model elsewhere, or for more detail about aspects of OLN 
mentioned earlier in this report. 

Overall program development rested within the theoretical framework 

of participative education, educational technology, participatory 

management and organizational development. Mainly used by the project's 

headquarters staff, the basic materials relating to those aspects of the 

project included the following: 

Argyris, Chris, Integrating the Individual and the Organization . 
New York; John Wiley and Sons, Inc. 1964 

Bennis, Warren G., Kenneth D. Benne, Robert Chin, The Planning 

cf Change . Second Edition, N.Y. Hilt, Rinehart and Winston, Inc., 

im 

Fordyce, Jack K. and Raymond Weil, Managing WITH People; a 

Manager's Handbook of Organization Development Methods . Reading, 
Mass., Addis on -Wesley Publishing Co., 1971 

Gagne, Robert M. "Educational Technology as Technique" in Introduction 
to Educational Technology . (Educational Technology Reviews Series) 
Englewood Cliffs, N.J. Educational Technology, n.d. 
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Grabowski, Stanley M. ed. Adult Learning- and Instmrtin n. 
ERiC Clearinghouse on Adult bducation and Adult Education 
Association of the U.S.A. 1970 

Knowles, Malcolm S. The Modem Practice of Adult Educa tion: 
Anoraqoqy versus Pedagngy. n y. n^^nr-i^fn-nn d^^.. ]f^-}^- 

Li f ton, Walter M. Working with Groups; Group Process and 
Indiviaual Growth . Second FHUi'nn m V LinM^y, ^oi^ 

Likert, Rensis, New Patterns of Managemen t. New York; McGraw-Hill 
Book Co. 1961 ~ 

Lynton, Rolf P. Training for Development . Homewood, 111., 
Dorsey, 1969 

Mage r, Robert F. Preparing Instructional Objectives . Palo Alto, 
Calif, Fearon Publishers, 1962 

Miles, Matthew B. Learning to Work in Groups. NY Teachers College, 
A Program Guide for Educational Leaders. Columbia University, 1961 

Schein, Edgar H. and Warren G. Bennis; Personal and Organi zational 
Change Through Groi ip Met.hnri«;. N.Y. Wiley. 1965 

Other resources were also used but for individuals interested in 

greater specificity, the above works can provide adequate additional leads. 

During the Staff Training Program, materials were provided in order 

to help field staff prepare for their institute responsibilities. The 

most helpful tool for the state coordinators was Conference Planning . 

edited by W.Wamer Burke and Richard Beckhard, (second edition, 1970, 

NTL Institute for Applied Behavioral Science, Washington, D.C.) Intern 

assistants were supplied Group Processes; an Introduction to Group 

fijmamicL. by Joseph Luft (Palo Alto, Calif. National Press, Second 

edition, 1970); and two volumes of the NTL Selected Readings Series: 

Group Development, (1961), edited by Leland Bradford and Leadership in 

Action, edited by Gordon L. Lippitt, (1961) both published by NTL 

Institu:e for Applied Behavioral Science, Washington, D.C. 

In addition to these basic works, articles, abstracts and other 

handouts were used during the training program and were distributed 

Q through subsequent mailings and meetings. Training information and 
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further references were supplied in the Network News Notes issues from 
November, 1971 to July, 1972. Each workshop had an on-site library of 
additional training materials which was assembled with the needs of the 
team in mind. It was available to the staff prior to and during each 
workshop for consultation. The OLN office also played an important role 
in the distribution of informational materials produced by the team 
itself, for example; the documentation of meetings, suggestions and 
ideas needing staff critique, etc. 

For Outreach Institute participants, basic materials were provided 
prior to the workshop they attended as well as a participant on-site 
library collection. For each workshop the project director and state 
coordinator assembled useful materials for participants to make use of 
in designing their action plan — general information about the needs 
within their state, background material on con?nunity-based outreach 
programming, examples of outreach programs used elsewhere, materials 
used with implemented programs ," selected library literature describing 
outreach programs, outreach bibliographies and materials on how to 
mobilize the resources needed for outreach programming. 

Materials provided each participant prior to the workshop included: 
1. a bibliography of background materials useful for those interested 
in developing community oriented outreach programs. 2. "Principles for- 
the Development of Programs of Service for the Disadvantaged by the ALA 
Coordinating Committee on Library Service to the Disadvantaged" (1971), 

3. information about learning and living in the workshop environment and 

4. a description of the educational methodology used at the workshop 
(See Appendix G). During the workshop handout materials on coninuni:ty 
resources, bringing about change, criteria for evaluating planning, the 

Q helping relationship, feedback, etc. were distributed at appropriate 
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times within the program. In addition, worksheets describing a step-by-step 
program planning process were given each participant. These were the basis 
for the workshop emphasis on action program planning. 

All staff, the Network Advisory Coimiittee menfcers and the Evaluation 
Team needed general up-dating information about the activities of the 
project. To meet this general need, the Network News Notes was supplied 
to these groups. Each institute staff team could benefit from reports made 
by and about the activities of the other institute programs, a valuable way 
to share the learnings among teams. 

Materials were also prepared and distributed to groups not directly 
involved in the project. A ten-page brochure describing the project in 
general terms was issued in the spring of 1972. It was supplemented later 
by an Update Sheet issued in May detailing the latest events and develop- 
ments. A second Update Sheet in July described the follow-up activities in 
each state after the workshop. These publications were intended to build 
interest and support for the outreach action plans developed and implemented 
by institute participants, to increase the number of librarians interested 
in networking about outreach and to supply the growing number of persons 
interested in the project with the basic information about it. Brochures 
and Update sheets were distributed to the Office of Education, all state 
library agencies, all library schools, major public libraries, ALA officers, 
state and regional library and trustee associations as well as all those 
who had been involved in OLN planning meetings and Outreach Institutes. 

The project's final report (i.e. this document) will have a similar 
distribution. This descriptive and evaluative report will provide a 
permanent and historical account of the project. The reason for this final 
institute report being more extensive than usual is our hope to be .able to 
^ inform groups interested in change, education and librarianship about this 
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model — why and how it was done, what are the results, outcomes and 
implications of the project as presently seen. Hopefully, this might 
encourage others to consider the validity of this model and to consider 
possible applications for similar purposes. 

Other attempts to tell about OLN and to advance the idea of outreach 
librarianship have included articles supplied to various library media and 
staff presentations at state and regional library association meetings in 
New England. Personal contacts by staff and participants with others 
interested in outreach librarianship have been fostered by two outreach 
"Open House" programs for the ALA conference in Chicago (1972) and the 
NELA fall conference in New Hampshire. These open houses were a means 
to encourage outreach-minded librarians to come together and exchange 
ideas (i.e>.p networking function) and to distribute OLN resources to 
individuals and groups who have not been part nf the Outreach Institute 
programs produced by the project. 

These were the elements of the operational program of the Outreach 
Leadership Network. These pages have related what was done to establish 
and maintain an administrative base for the project, to develop the 
leadership training program and to produce the four outreach institute 
programs. Staffing and materials used for each of these major areas of 
activity have been described. All project activities were planned to 
accomplish the project objectives to some degree and in a particular way. 
Thus, the entire plan of operation needs to be viewed in close relation to 
the objectives of the project stated in the beginning. Another element 
to understand in relation to the plan of operation is that of the 
operational problems that were encountered. 
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MAJOR PROBLEMS 

The major problems encountered by the project were surprisingly few. 
No problem actually prevented project activities from being conducted. 
However, each of the following problems was sensed by some of the OLN 
component:; and did limit the intended effects of the project. 

The tight scheduling of multiple activities (see Figure 2 and 
Appendix F) and the need for extensive travel placed heavy demands on the 
headquarters and field staff. Most project activities had both 
administrative and educational functions. Since many aspects of the 
project were a source of jeaming for the first cadre, a constant 
"teaching" function rested with the headquarters staff in addition to 
their administrative responsibilities of managing the project. Even though 
extensive prior experience with these dual roles made both feasible, the 
strain was tremendous. 

The combined administrative and educational emphases existed tf-iroughout 
the project. Another constant was the pressure for immediate action and 
quick results counter-balanced by the need for careful development of a 
sound base to be a lasting result of the project. A recommendation in 
response to both of these "problems" would be for the project to have been 
planned over a longer time spin and to have included more staff. 

Another problem encounte ed by the project was that the acceptance of 
the OLN educational methodolooy by some institute participants was hamperod 
because they had formed unrealistic expectations as to the nature or 
outcomes which could be expected from the institute. Correspondence and 
written preparatory materials were the main means of communicating the 
nature and intents of the program, but face to face dialogue would have 
been a more effective method. Some of these dialogues occurred informally 
but were not intentionally planned on a systematic scale. The 



recoiranendation which can be drawn from our experience with this problem 
would be the utilization of field staff to meet with participants prior 
to the program and help them form realistic expectations in regard to the 
nature of the program and the results which could be anticipated as a 
result of their participation in it. 

Perhaps the most frustrating problem encountered by staff and 
participants in the project as well as by those outside the project has 
been the inability to measure the leadership development element in terms 
of results. Short-range evaluation is useful. Speculation based on the 
evidences at hand is interesting. But the real measure of leadership 
initiative and the assumption of responsibility in personal, professional 
and civic 'endeavors can only become evident and be substantially documented 
from three to five years later. Our strongest recommendation resulting 
from the experience with this project is to build in the possibility of 
long-term evaluation beyond the funding period of the institute program 
itself. This would enable a more reliable test of the validity of the 
program that was funded, and increase the possibility of incorporating 
those results into subsequently funded programs. 

These are the significant problems that were encountered during the 
course of the OLN project. In addition to these, there were some 
situations which posed themselves and which did affect project operation 
and outcomes. However, they cannot properly be termed '"problems" and they 
are commented on throughout the report in the section or sections to which 
they relate most strongly. 
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The Outreach Leadership Network model has been described here in 
this degree of detail in the hopes that others interested in a model of 
this nature would be aware of its multiple and complex demands. 
Essentials of sound program planning and development have been highlighted 
within this report; 

1. an accurate and realistic perception of the needs that are intended 
to be met by the activities '^f the project - and constant contact 
with those needs throughout the program to assure that they are 
still realistically perceived and are indeed being met by the. 
activities, 

2. clear project goal and objectives which have been substantially 
based on real needs of the recipient of the services and against 
which all activities must be tested to check the relevance of those 
activities within the project, 

3. a reliable and flexible organizational structure which is solidly 
built on valid theoretical framework and directed toward the 
organizational goals, and 

4. skilled and experienced key staff members responsible for planninji, 
implementing and evaluating the project. 

All activities throughout the project, have been intended as practical 
applications of theory and as opportunities to learn. This report is also 
intended to meet those criteria. Tlius, by reading the report, individuals 
who were involved in the project activities can see more clearly the overall 
scope of the total project and understand a greater reality in their own 
involvement. Those not involved in the project see the totality without 
the personal experience to which to relate it. 
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OUTCOMES 

The nature of the model has been described: its intents, its 
operation, its components. The results of the Outreach Leadership 
Network also need to be described to see the possibilities offe,-^d 
by this model. The on-going effects from the project as a whole 
interweave many identified outcomes into a fabric of change for public 
librarianship in New England. 

The kinds of outcomes that have resulted from the prcjQct are as 
complex as the nature of the project itself. Well -documented, short- 
range outcomes are reported by the Evaluation Team in their report, which 
is part two of this document. Observed and anticipated outcoires from 
a. staff perspective is offered here to supplement that report. Review of 
these observations might result in ideas on bow to stimulate future growth 
and development, not only in H^l England librarianship but possibly in 
other regions and in other professional fields. 

The outcomes described here fall into two categories — observed 
and anticipated. The observed outcomes are from a staff perspective. 
Evidences of these outcomes have come from staff observations of behavior, 
self-evaluations of the participants and written and verbal comments from 
others, usually colleagues. Anticipated outcomes are those which have not 
yet actually "occurred but which have strong indications for becoming real 
and tangible results. The importance of the anticipated outcomes rests on 
the possibility that these will tend to become cumulative in their influence 
and to become forces which come together to result in new efforts which are 
not able to be predicted or to be dictated at this time. However, it is 
helpful to begin to look at the future while still in the present. 

Many of the outcomes, as could be expected, relate directly to the 
objectives of the project — to develop the ability of public librarians 
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to formulate and implc-snt action programs of library outreach and to 
develop a core of library leadership able to evolve a network which 
could continue the impetus of the project beyond the duration of the 
funded period of the project. Other outcomes are by-products, not 
specifically planned for but important results from the project. 
Throughout this section of the report, these outcomes will be grouped, 
by paragraph, into general categories. 

The first portion of this section will cover multiple outcomes of 
those directly involved with the project - participants of the outreach 
institute programs and participants of the leadership training programs. 
The second portion will describe outcomes in relation to the groups 
which have not been directly involved with the project but which have 
been and will continue to be affected through the impact of the involved 
participants. These groups include New England public libraries, local 
communities, state library agencies, state and regional professional 
associations. 

Nearly all participants in the outreach institute programs spoke 
of the importance they attached to the institute experience as a means of 
widening their horizons. For many, new vistas opened outreach 
librarianship, continuing education opportunities, the professional 
community, idea exchange, excitement of learning, discovery of self and 
others as valuable resources. Broader awareness of who is doing v^hat in 
the professional field and talking shop with enthusiastic colleagues 
pulled some participants out of a narrowly circumscribed usual routine. 
These kinds of discoveries kindled an enthusiasm difficult to- explain to 
thosa who were not there to share it. 

For some librarians, there was a new awareness of the importance of 
the librarian in the deTivery of effective library services to a community. 
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The librarian is the key, the responsible element for whetfjer the library 

is one of action or apathy 1n the community, inis realization can hit 

hard for the responsibility is heavy and soto participants found It weighty 

with them. In each outreach institute program, those who had done outr*each 

instinctively and well for a long time communicated that attitude to those 

« 

for whom it was the new, "in" thing to do. Some moved from viewing outreach 
as an impossible goal to a "can do" attitude, combining the initiative 
to take on a new program with an awareness of what it takes to do a good 
job of it. Some participants saw themselves as librarians and as citizens 
in relation to outreach services for the first time. 

An immediate and observed outcome for Institute participants 
certainly included the excitement of the exchange of ideas and experiences 
J with other participants the sharing of the institute experience of 
using a common action planning model and problem-solving process to- 
develop a community-based program of services. The workshop learnings 
were reinforced by the follow-up activities in this respect. There was 
a broadened awareness of the what and how of outreach — what outreach 
means in terms of assessing community needs (i.e. really knowing the 
needs of the community) and how library services can relate to those needs. 
For many, the importance of careful but flexible planning for a new 
program together with attention given to the strategies of its 
implementation and evaluation were elements which had been overlooked 
before. Full use of the available outreach resource materials and 
consultant staff not only initiated this approach but sustained it 
subsequent to the workshop. 

In addition to expanding knowledge of the techniques necessary for 
effective outreach librarianship (e.g. program planning, evaluation 
id . techniques, coh^nlty needs assessment), participants were able to deepen 
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outreach attitudes and practice interpersonal and group skills which 
are needed in developing and implementing new programs within a community. 
Increased communications skills, both personal and organizational, and 
the ability to work effectively in small groups were areas of observed 
improved competence. Participant's increased ability to relate quickly 
with others and to discover those with similar interests and concerns came 
later but did result from involvement in the institute programs. 

These were some of the observed outcomes in relation to the outreach 
institute participants. Substantial indication of results which will 
become evident later indicate the following as possible outcomes that may 
be expected to result from the project: Public librarians will evidence 
a wider sense of colleagueship within the field and shew a greater interest 
in and commitment to professional endeavors in general, continuing 
education opportunities, in particular. Librarians will demonstrate a 
willingness to take the initiative and responsibility to do things that 
need to be done and to support such initiatives of others in areas of 
mutual concern and interest. Librarians will view the feasibility of 
interstate efforts and plan for the future on a regional basis for issues 
and activities. Librarians will apply what they have learned about program 
planning, change, evaluation, conmunity involvement, etc. into other aspects 
cf their personal and civic lives as well as their library careers. 

Further outcomes which can be anticipated from the outreach institute 
participants. relate to their awareness of the value of a network of 
colleagues with common concerns and copiittnent ~ awareness that there is 
such a network possible and that they can be part of it. These librarians 
will probably utilize networking extensively to focus communications 
regarding what is going on in the field, what are the issues that, face then., 
who is concerned about those issues and who wants to try to do something 
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about them. Thus, the network will be able to serve as a means of 
involvement. Librarians seeking to become involved have a route to find 
meaningful involvement; librarians seeking to involve others have a 
channel to do that. They will probably use the network as a support to 
provide the security that comes from knowing that problem-solving 
helpers can help them attempt new efforts. 

All of the outcomes ~ both observed and anticipated — that are 
indicated for the outreach institute participants are also very true of 
those involved in the leadership development, program. Depth of learning 
for the latter group was considerably greater than for the former, but 
the areas of learning were similar. These are areas in which knowledge 
does not become complete, nor learning stop. Several reasons explain 
greater depth of learning for the leadership cadres: The learning needs 
of the two leadership cadres were responded to more individually; more 
extensive and sustained exposure to a variety of learning situations and 
materials was possible; greater attention was given to the process of 
learning how one learns; repeated opportunities to learn from each other 
provided frequent and valuable reinforcement. More direct and more constant 
observation by the staff through the team working relations^hip offered 
' greater opportunity to obtain first-hand observation and to hear self- 
evaluations from the individuals attempting to apply learnings in situations 
which also involved the staff. Consequently, the reported outcomes 
relating to the leadership cadres are at a greater depth and detail than 
in other portions of this section. 

The concentration on learning the how of what happens rather than just 
the what was the main difference for those ir^ the leadership cadres. For 
the members of the first cadre (the intern assistants and state coordinators), 
O one of the most significant outcomes was the ability to look analytically 
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at the elements of the situation, to elicit feedback from others and to 
examine the process of what is happening or has happened. The depth of 
this process was possible because of the trust relationship that existed 
on each team and, to some extent, between teams and the requirement for 
documenting OLN meetings. "Debriefing" offered the individual an 
opportunity for self-assessment in terms of attitudes, skills and knowledge 
of outreach librarianship, of educational program planning and of working 
helpfully with groups. This process skill has a particularly long-range 
effect for it enables the individual to learn from his experiences 
throughout a lifetime. 

This close and trustful working team relationship operated in 
concert with the awareness that professional and peer back-up support 
was available and with the individual's deep motivation to learn. These 
three factors combined to encourage individuals in cadre- one to attempt 
to build new skills and to try leadership functions they had never before 
attempted. From those personal extensions came a deepened sense of the 
nature of leadership responsibilities and the basic concerns of those who 
find themselves in leadership positions, the ability to determine and 
create what needs to be done. Many involved in the leadership development 
program utilized this opportunity to gain a sounder sense of where one's 
self is in relation. to the world as a whple and to librarianship in 
particular. To some extent these outcomes were exhibited also by the 
participants of the August (1972) training program but the OLN-initiated 
learning opportunities will not be the basis for their continued learning. 

Members of both cadres developed firm bases for skills of analyzing 
the needs of a (learning) community and applying that to the hon'£ community, 
of observing and intervening in a group situation to accomplish the tar,k 
effectively, helping groups to reach consensual decisions, planning action 
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programs, eliciting program feedback and planning evaluation. More 
specifically, the skills which developed from the leadership development 
program, particularly with the first cadre, were those of planning 
and conducting meetings (e.g. developing a planned and flexible agenda, 
getting participants involved in the decision-making, utilizing newsprint), 
relating communications skills directly to outreach efforts, learning how 
to build and work as a team, and documentation skills. An important 
theme throughout the leadership development program was the intimate view 
that comes from putting into practice the principles contained in a 
theoretical framework and examing that process for what it means for 
oneself. 

Outcomes which can be anticipated from those involved in the leadership 
development program are multiple, and give indications that they will 
affect participants as individuals, as professionals and as citizens. 
These librarians ar3 expected to evince a continued interest in personal 
and professional self-development possibilities with a greater degree of 
certainty for which areas they want and .need in order to grow and the best 
ways for them to do that. In addition to influencing the individual 
librarian, libraries, state agencies and professional associations will 
probably be affected by increased pressure for more emphasis in staff 
development opportunities and continuing education efforts. The OLN 
librarians will probably respond quickly to those opportunities that meet 
their needs and will undoubtedly initiate requests for additional programs. 
From their new awareness of New England resources which are available — 
people, facilities, materials and money -- they will present a persistent 
and substantial influence for more continuing education efforts. 

These librarians will display a greater willingness to assume leader- 
ship roles and responsibilities — with greater vision qf what needs to ba 
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done and how to do that, backed with the support base of knowing others 
in the field who ft el similarly. The added benefit of their ability to 
work collaboratively on ad fioc task-oriented teams will provide a 
strength not now predominant in the field. They understand the value 
of bringing together different perspectives, skills and resources 
centered upon common commitment and the importance of focusing that on 
the task to be done. This ability will certainly influence coimittee work 
substantially as they meet professional responsibilities on staff 
committees, in association endeavors and within the communities of which 
they are a part. 

These librarians have the experience not only of initiative 
functions of leadership but also of its supportive functions. Their 
own willingness to assume leadership initiative responsibilities will 
quickly become evident. At the same time, many will prefer to work in 
supportive ways to encourage others to assume the initiative with 
themselves serving as back-up. This will be true in a personal Wco^ 
between individuals. It also may become evident in organizational ways 
for the participants in the leadership development program have a greater 
sense of organizational skills - how an organization needs to construct 
its communication and decision-making ability, how to build for the 
future of the organization as well as for the present, how to evolve 
organizational objectives and how to plan for the accomplishment of those 
objectives. This kind. of effort may be less obvious but is often more 
effective over a long period of time. First-hand experience with the OLN 
organization provided a training ground for organizational awareness and 
skills. 

The ability and inclination to think, plan and act on an interstate 
basis is even more true of the participants of the leadership development 
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program than of those in the outreach institutes. The impact on state and 
regional professional associations and on state and regional library 
agencies is likely to be great if OLN participants can be incorporated 
directly or indirectly in those efforts. The potential ability of this 
group of librarians to formulate a human network that can serve 
communications and decision-making purposes within New England librarian- 
ship is substantial. Some possible directions that can be envisioned 
include a greater emphasis on outreach librarianship, deeper concern with 
conmunity needs, greater awareness of the importance of planned change to 
accommodate the changing world. The OLN librarians sense the need to 
"outreach" to their colleagues. If they are successful in acting on that 
need, their impact will be able to be significant. If maintained on an 
informal basis, this network can facilitate idea exchange. With formal 
structure and substance it might become a significant force for 
constructive change within New England librarianship. 

The observed and anticipated outcomes described above have related 
to those who were participants in the educational activities of the 
Outreach Leadership Network. However, these have not only described the 
personal impacts resulting from irivolvement in- the program but also have 
shown how that personal impact in turn affects the svs-jems within which 
those individuals live and work. Because opportunities for observation 
have been limited, the observed and anticipated outcomes in relation to the' 
New England public libraries and communities and the state library agencies 
and the state and regional associations will be but briefly related. 

Within the local libraries from which participants came to the OLN 
outreach institutes, the most immediate impact observed was the injection 
of new ideas — in some cases, plans for a new program of services or new 
9/-- ^^^^ *° ^"'^ extend present programs together with the excitement on 



the part of the returning participants who transmitted greater enthusiasm 
to the local library about outreach ideas through sustained network 
contact with other libraries and librarians. This access gives the benefit 
of a richer resource base as well as a broader awareness of what outreach 
is being done in the region and 'what resources are available to do it. 

Another observed outcome with the local libraries is the immediate 
and direct influence on other staff members who have been included in 
planning for new outreach services. This reinforces outreach attitudes 
already present at the same time as it fosters such attitudes where they 
did not already exist. Outcomes which can be anticipated for the future 
with a fair degree of certainty would include more soundly planned 
programs which utilize more extensive conmunity and staff involvement 
and librarians who have a greater awareness of what, is being done elsewhere 
and the resources that are needed for effective programming and who are 
willing to attempt new efforts of outreach. 

Ultimately, in accord with the goal of the project as a whole, the 
anticipated outcome is for more effective libraries throughout New England 
to deliver quicker and better information services more equitably in 
response to community needs. 

An indication of one of the most significant areas of OLN impact in 
New England can be seen in the immediate and observed outcomes in the 
local New England communities from which the participants came. After the 
outreach institutes, the librarians were more inclined to involve citizens 
of their communities in the development of new outreach programs or in the 
evaluation of the present programs. Now, the librarian is apt and competent 
to view community needs carefully and systematically in relation to library 
services. The librarian has a greater tendency to see himself and the 
library as a coirmunity resource and to be interested and able to utilize 
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other resources within the community more creatively. This, in turn, 
fosters better use of community resources. An anticipated outcome of the 
project is the possibility that the library, as a social institution in 
the community and as a municipal agency, may become more receptive to 
cooperative planning with other community service agencies — or might 
even initiate such efforts. 

Other anticipated outcomes also relate to the library as a member 
of the municipal agency family. Librarians with the ability to plan new 
programs based on careful assessment of community needs and the ability to 
communicate those plans will be able to sustain or perhaps increase the 
priority of library programs in the allocation of community funding. 
Effective presentation backed by careful planning with community involve- 
ment may impress communities as to the importance of a vital public library. 
Continuation and expansion of the current efforts already underway of the 
exchange of programs between librarians through contacts made at the OLN 
programs will make greater inter-community cooperation more possible in the 
future. 

At the state level, both observed and anticipated outcomes can be seen 
in relation to state library agencies and state library associations. Some 
state outcomes related generally to both organizations; other outcomes 
relate to one or the other in a particular way. It is important to note 
parenthetically that each of the six states presents a unique situation 
which means that local interpretation, application and adaptation of these 
outcomes has been individualistic for each state and for each organization. 
Generally, observed outcomes which relate to both organizations in each 
state have included improved library outreach services in several libraries 
within the state. These programs of service tend to be better planned, to 
employ better use of resources and to show a closer relationship between 

community needs and library services. 



The state library agency and the state library association are both 
designed to serve the needs of librarians in the state each has a 
stated function of providing for continuing education for librarians. 
The OLN project has provided continuing education opportunities designed 
to build professional knowledge, skills and attitudes regarding outreach 
program development in libraries. Thus, the project furthered the 
educational aims of both organizations. Active individuals in the agency 
and the association were included as participants in OLN activities. Thus, 
a direct impact was possible as the institutes improved the skills of 
consultants, officers and committee workers. In a sense,' OLN provided an 
opportunity to each organization for staff development of its personnel. 

This was particularly true for the state agency. The OLN state 
coordinator position offered the opportunity for state personnel to 
improve conference management skills. This could result in a long-range 
outcome of more and improved continuing education programs in the area of 
outreach librarianship and program planning developed by the agency. 
In addition, several state agency personnel usually those responsible 
for consultant and special services — were participants at outreach 
institutes and at the training program. Consequently, an immediate and 
direct outcome was the increased first-hand awareness on the part of the 
state agency personnel of the needs of the librarians in the state and 
resources available to fill those needs. Similarly, participants became 
more aware of the services, resources and personnel available through the 
state agency. Thus, the establishment of a communicative and helpful 
relationship was possible through OLN activities. This could cortinue 
to develop and become a significant long-range impact of the program at the 
state level. This example illustrates how mutual needs and goals can be 
met through a common program. 
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For the state library association, the immediately observed outcomes 
relate to the increased professional Interest and involvement by OLN 
participants who were stimulated by exchanges at workshops with colleagues, 
some seeing for the first time the possibilities that state associations 
offer for an active membership working together on common concerns. 
Association activities are an excellent field for the application of 
leadership skills, program planning and the ability to work effectively 
with groups. Activation of outreach interest groups within state 
associations has been an immediate and direct outcome. The extension of 
an outreach approach throughout many association activities may be an 
anticipated outcome. Associations have benefited from active involvement 
of OLN participants and OLN participants have found association activities 
related to their interests and somewhat responsive to their concerns. 
This is another example of mutual needs and goals being able to be 
simultaneously served. 

Anticipated outcomes for both organizations in each state include the 
possible responses to pressures generated by strongly committed librarians ~ 
interest in more continuing education programs, involvement in planning and 
decision-making in matters that affect them, need for information and 
services provided by these organizations, concern for the incorporation of 
outreach approaches in various areas of professional activity. Corollary 
to this pressure will be the willingness of many librarians to share some 
of the responsibilities in the development of these directions and their 
ability to work effectively with individuals and groups to get things done. 
More needs may now become evident, but more resources have also been 
developed. 
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As expected, the outcomes from this complex project have been just 
as multiple and varied, as it:; activities. Each individual involved in 
the program was directly influenced by his/her participation and. in turn, 
affected other individuals and organizations. These observations as to 
the immediate and anticipated outcomes are from a staff perspective and 
have been reported here in order to indicate in what ways the influences 
of the Outreach Leadership Network project might affect the future of 
New England librarianship. Obviously none of these outcomes will be 
solely due to the project. Each outcome must have interest and nurture 
from librarians, state agencies and state associations as well as good 
fortune, in order to become real. The project activities offered a 
catalyst for many outcomes. For some efforts, that catalyst was premature; 
for others, it was tardy. It will have been an effective catalyst for 
those efforts for which was timely and relevant. 



In conclusion, this report has intended to present an account of 
the Outreach Leadership Network which will interest those who participated 
in its activities and those who never knew it happened until now. The 
details of the operational model have been set in the context of its 
background, its premises and the theoretical framework upon which it 
was bas -Briefly stated, OLN was a model of an evolving organizational 
structure which produced participative education activities. These 
activities consisted of action training and leadership development 
programs which were systematically designed to deepen coitmi tment and 
increase the capability of public librarians in New England who were 
interested in outreach librarianship. Throughout its life, the organizatio 
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was administered by means of participatory management methods using ad hoc 
task teams. From the beginning the OLN was meant to be transferred into 
the hands of those who had been active in its program and who were most 
committed to its goals and methods. The intent of the proposers and staff 
of the project was not only to build an operational structure for its 
funded life but to evolve a method which could extend the initial thrust 
into the future. Thus, if relevant and timely, this process might continue 
to enable public librarians in New England to participate meaningfully 
in the process of planning and effecting constructive changes in their world. 



To what extent these intentions have been fulfilled is not yet 
completely clear but substantive evidence shows strong indications that 
the OLN project was able to produce the resources necessary that could 
be used to build on and to sustain the impetus provided by the initial 
catalyst. Within this one and one-half year period, an extensive bank 
of resources (people, ideas and materials) has been developed. The next 
step to fulfill the intent of the model is for New England librarians to 
utilize these resources and take initiative and responsible moves to 
sustain or redirect the thrust begun by the project. Briefly reviewed, 
these resources include: 

Librarians (113 participants from -Outreach Institutes and 69 involved 
in the training programs) with a high leadership potential, a 
commitment to outreach and an action orientation have shared learning 
experiences across state Tines • They are trained in the ability to 
Q plan and implement programs; they have established communication 
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with each other and, have a regional outlook; they" have evidenced 
their interest iii continuing education with a , view of their ov^n 
learning needs and new perspectives on how to fill those needs. 
The training ground provided by the practical application of the 
project's methodological approach yielded idea resources which are 
now available for application by library schools, state agencies 
and other projects as well as for librarians to utilize in their 
libraries. In addition to the concepts of participatory management, 
organizational development and participative education, the value:> 
, of networking, of working collaboratively on a common task and 
involving the community in decision-making were discovered by many 
who have been involved directly in the program. 
Materials resources compiled for the project activities included 
a step-by-step action planning model, an outreach bibliography, a 
brochure describing the project, documentation forms for meetings 
and workshop sessions and a collection of outreach information and 
training resources. 

The skills of action-planning are being directly and immediately 
employed by key leaders who were involved in the program. As a result 
of their shared interests and concerns, two groups have formed and, 
through the fall, have firmed up action plans, integrated and coordinated 
their efforts to reveal that the elements of the next steps — New England 
librarians utilizing these resources and taking initiative and responsible 
moves ~ are possible, feasible and in view. The two groups are: 

Task Force on an Outreach Information Clearinghouse seeks "to consider 
and implement the idea of an Outreach Information Clearinghouse, a 
centralized continuing activity for the collection, organization and 
dissemination of information about outreach." Their immediate task 



is to produce a directory of outreach public library programs 
developed by those in the OLN institute programs. The directory 
is scheduled for distribution in January, 
The Steering Committee seeks to provide for the organizational 
continuity fo. the project. This group in conjunction with the 
Continuing Education Committee (a subcommittee of the Regional 
Planning Committee) of the New England Library Association has 
petitioned and become a section of NELA to be known as New England 
Outreach Network (NEON). 
The unifying goal under which both of these .efforts combine is: 
"to provide educational opportunities not now being offered by existing 
institutions in New England and to those concerned with the field of 
information to be able to manage and deal with change as well as create 
necessary changes so that information agency's staff and clients could 
become more actively and effectively involved in their respective 
communities." 

Each of the elements of the project ~ outreach planning, leadership 
development and networking opportunities ~ was designer* to provide the 
basis for a regional outreach network. Librarians who were In the 
program are now providing d thrust of renewed vitality to New England 
outreach librarianship. If their efforts succeed and continue, much 
effort and excitement lie ahead as their goal comes into view. 
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I. INTRODUCTION 

The Evaluation Team was assigned the task of evaluating the Outreach 
Leadership Network project as described in the Plan of Operation. The 
exploration of new approaches to context, input, process, and product 
evaluation was an added responsibility that, was assumed by all members 
of the Team. This report is organized to provide the reader with some 
understanding of the process by which the Evaluation Team solved its 
problems and made its decisions, as well as the conclusions that it 
reached. 

A brief glossary of terms is included to facilitate communication 
because many terms such as community, goal, and network have particular 
meanings that could be confusing to the reader who is not aware of the 
special definitions used in this report. 

Tne rationale for the Outreach Leadership Network (OLN) was extracted 
from various documents prepared by the OLN staff, but selected by the , 
Evaluation Team. The goals and objectives from the Plan of Operation, 
staff-formulated behavioral objectives, goals and objectives prepared 
by four institute planning committees, and goals end oojectives prepared 
by the planning cormittees for the two Training Programs are the "base- 
lines*' of accountu-jility which provide the basis for evaluating the 
effectiveness of the project. 

The rationale and methodology for the Evaluation Team were developed 
by the leam based on the role defined in the Plan of Operation. The 
rationale ai.** methodology utilized the CIPP approach but W3re influenced 
by the unique requirements of the OLN program, with special attention 



given to both process and product. 

The description of the evaluation process includes the scope of the 
evaluation program; the major sources of evaluative data; participant 
selection criteria; demographic characteristics of participants, Intern 
Assistants, and State Coordinators; information about the characteristics 
of the institutions from which participants and Intern Assistants were 
selected; an analysis of responses to the Post Institute Survey Question- 
naire; and an analysis of the. leadership training conponent, which in- 
cludes patterns of implementation of action plans and indi catlpns of 
network maintenance. 

The observations of the Evaluation Team are statements about 
activities or events occurring during the OLN pragram which would be of 
interest to planners of related programs. 

The recommendations are offered by- the Team as information upon 
which recycling decisions can L. made by planners and supporters' of 
similar or related programs. The filial .conclusion is a tribute to 
Barbara Conroy and Larry Allen who are modestly called the Project 
Faculty. It is an und2rstatement tj point out that the complex OLN 
experience would be difficult to replicate without their unique personal 
qualities, skills, and dedication. 
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II. GLOSSARY OF TERMS 

The following terms are defined as they were used in this program. 

. Action Plan A statement of the way a program of library services 

will be developed, implemented, and evaluated. 

Action Planning ... A systematic problem-solving approach to progfafrTplanning 

including program objectives and rationally developed, 
goal -oriented activities. 

Community A group of people having coimicn interests. 

Feedback The verbal and non-verbal messages which give a person 

in^'^rmation on how he affects others. 

Goal An idealized statement of the desired outcomes of a 

program or project. 

Inttitute Progrerri . . The totel educational program offered in a particular 

region by OLfi, made up of the following components: 
a) preliminary activities - the use f.^ instrun^nts 
and activities designed to broaden the community aware- 
ness of the librarian and gather data useful in action 
planning; i.e., activities intended to aid participants 
in becoming aware of conmiunity needs and attitudes which 
will be the focus or their action program developed at 
the workshoD. 

. " b) workshop - a concentrated sequence of work sessions 

which involve the participants 1n a step-by-step develop- 
ment of individual action program:-, 
c) foTlaw-up activities - those, activities whidi will, 
facilitate the action plans and leadership skills developed 
at the workshop. 

Intern Assistant . . An individual selected to participate in a two-day 

training program designed to prepare him/her for involve- 
ment as an intern in the subsequent Institute. 

Learning The discovery of the personal meaning and relevance of 

ideas through experience; a cooperative and collaborative 
process with built-in opportunities for self-assessment 
and reflection and the exchange of ideas with others. 

Needs Assessnfcnt . . The process of identifying and defining deficiencies 

which includes procedures designed to alleviate the 
deficiencies. 

Network A system of elements which ar^: interrelated for a common 

purpose: to open and maintain channels of communication 
among people in a community, within a state, and, across 
state lines, within the region. 
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?) General - general statement of how the program will 

attempt to reach the goal or goals, 
b) Behavior^ - a statement of the specific steps that 
will be taken to achieve a goal. Basic elements of a 
behavioral objective involve the conditions under which 
the lavior will be expected to occjir, the nature of behav- 
ior - be exhibited, & the level of acceptable peKormance . 

^^^""^^^^ The extension of library services to tho previou-^lv 

unserved. r • j 

Project Staff .... Its members incfude the Project Director, Project Con- 
sultant (thase two also constitute the Project Faculty) 
Project Coordinator, and Project Secretary/Assistant; 
also known as Headquarters Staff. 

Staff, facilities, money, materials, time, etc. 

^^'^^^ Proficiency in applying knowledge towards the accom- 
plishment of an objective. 

State Coordinator . . An individual selected by -ach state library agency in 

New England , troJned as a resource person to a staff 
team, & primarily responsible for the local arrange- 
ments for an institute. 



III. f-.ATIONALE FOR THE NEW ENGLAND OUTREACH LEADERSHfP NETWORK (OLN) 

The following statements were extracted from various documents prepared 
by the OLN staff to communicate the rationale of the program to selected 
audiences. 

As a social institution responsible to the society in which it lives, 
and as a service agency responsible to its clients, the library must look to 
new patterns of service, to new roles in the community. For the public library, 
these new patterns and new roles will come from added services, in terms of 
outreach programs, to those segments of its clientele not now served. 

Librarians must be ready and able to deal with the rapidly changing world 
which is bringing community libraries into more direct and confronting contact 
with hew elements of its client population. Skills and know-how are needed 
to actually effect change in institutional service patterns so that the 
Er|c potential for making the library an effective agency in reaching out is able 



to be realized. 

Through initial programming and staffing, this project was designed to 
develop a strong core of individuals within New England library leadership, 
a human resource base with the conviction and the capability to mount state 
and regionwide programs via a sustained network which can broaden and con- 
tinue outreach efforts through public libraries. Thus, though the ultimate 
client/ consumer affected by the program was the community citizen, the client/ 
consumer of this project was the librarian needing to develop his/her ability 
to reach that ultimate client more effectively. 

IV. GOALS AND OBJECTIVES OF THE OLN PROGRAM 

The full listing of the goals and objectives of the OLN program, and 
the n^ans by which they were to be attained, may be found in Appendices 
A, B, and C. .! 

A* General Objectives 

The overall goal of the Outreach Leadership Network, as outlined in the 
Plan of Operation, was providing for more effective public library services 
d irected toward presently unserved community groups . This network goal was 
to be accomplished by attaining the following general objectives: 

1) to develop the ability of public librarians to formulate and imple- 
ment action programs of library outreach through institutes designed to 
develop and test commitment and to build skills of outreach action 
planning; 

2) to develop leadership and organizational skil/s of individuals who 

will evolve a network to continue the outreach impetus of the project 

V 

through training programs and opportunities to deepen their skills. 

4 
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B. Behavioral Objectives 

The following behavioral objectives were formulated by the Project 
Staff for the program: 

1) participants will be able to formulate a community-based action 
program designed to extend library services to specific target groups 
ir, their community which they determine to be inadequately served; 

2) participants will be able to implement a community-based action 
program designed to extend library services to specific target groups 
in the community; 

3) members of the training and administrative staffs will demonstrate 
the.ir leadership and organizational skills in carrying out their 
responsibilities with Institute participants and other staff members - 
before, during, and after the institute in which they serve and in the 
training program(s). 

C. Institute Objectives 

The following statements comprise the explicit goals -anti objectives of 
. each of the four institutes of the Outreach Leadership Network program. Each 

cluster of goals and objectives were set by the institute staff teams from 
input .gathered d:iring planning committee meetings. The goals and design of 
each institute were tailored to meet the needs of its own participant group, 
and therefore differed in some respects from the- other three. 

Rhode Island ; 

Purpose; to plan and implement action programs of extending public 
library services to unserved people in Rhode Is"'and coimiunities . 

Objectives; to increase the librarian's ability to 

—assess needs and resources in the community, in the library; 

—work effectively with group's; 

—develop effective means of communications with individuals and groups 
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-use the program planning process, to develop action programs of 
outreach; 

-develop ways and means for implementing action programs; 
-evaluate action programs in terms of results and effectiveness. 




Massach usetts; 



Objectives : 



—to increase the librarian's ability to assess the attitude of one's 
self and one's institution toward outreach; 

--to become aware of community needs and resources; 

—to increase skills of planning of outreach action programs; 

—to increase skills for implementing an outreach action program; 

—to increase skills for evaluating outreach action programs; 

—to increase the ability to build support for programs (s-iaff, 
board, community groups, etc.). 



Connecticut: 



Goal: to increase personal effectiveness of each participant in working 
with people and programs in order to be effective In^^reaching unserved 
groups, and individuals. 

Objectives: 

--to learn techniques for developing support systems with colleagues, 
staff, and community to facilitate initiating and maintaining out- 
reach programs; 

--to improve the ability to communicate by listening, questionning, 
clarifying, etc. ; 

—to build skill'j for outreach action programming, including planning, 
implementing, and evaluating; 

—to improve the ability to work in and with the community by creating 
awareness of its needs, resources, and responses, by improving the 
library's approachability and by eliciting community "feedback." 
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Northern States : ' 

Goal: to enable librarians to make their libraries a more dynamic and 
action-oriented part of the community by increasing their effectiveness 
in serving unreached groups in the community with library services. 
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Objectives : 

""Snami^s; ^w^^^ness of coi^nity: its nature and 

""w?tj"JiSf ^ '^'^ '-l^'*^ °^ librarians to «nicate and cooperate 
with their commumties and with other librarians; cooperate 

-to build skills of planning effective outreach programs; 
"to build skills to implement (put into practice) action programs. 
D. Training Program Objectives 
The first Training Program was convened during October 17-19, 1971 and 
occurred prior to the Implementation of the Institute segment of the project. 
It was designed to prepare Intern Assistants and State Coordinators to parti- 
cipate fully in each institute. The following, objectives were established 
for this Training Program by the Project Director, faculty, and staff: 

1) to prepare Intern Assistants and State Coordinators for their re-oer 
tive responsibilities bafore. during, and after an outUch [nsti'tute; 

2) to provide an initial assessment of participant needs and resources; 

3) to select four teams - each responsible for an institute; 

4) to develop tsam relationships as a base for- working together; 

5) to discover and share avail able. resources to be used with institutes; 

proSpfannin"gf °' '''''''''' ''''''' 

7) to hegir\ to explore the devGlopment of a network. 

The c,econd Training Program occurred tc-n months later, after the conclu- 
sion 0^ the workshoD series, during Augus t 27-31 . 1972. Participants from 
the ;our institute programs and some Intern Assistants were selected on the 
basis of their interest, skills, cor.initment. and potential for sustained 
outreach leadership. In response to the participants' expressed needs, the 
following goals and objectives were developed by the Training Program faculty: 

.^•ntergroup^'JaK! °' '''''''''' '''''' ''''''''' 9-up and 
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Objectives: 

1) to establish a climate for self -directed learning; 

2) to assess the specific needs, interests, and resources of 
parti ci pants; 

3) to idantify one's present style of leadership and its impact 
on others; 

4) to identify, explore, and practice the skills of leadership in 
various group and intergroup situations (e.g., decision-making, 
problem-solving, communication, and intergroup dynamics); 

5) to apply and use these leadership skills toward group task 
accomplishment; 

6) to evaluate our learnings and their application to "back-home" 
settings. 



V. RATIONALE FOR EVALUATION AND THE TEAM APPROACH 

To fulfill the requirement for evaluation by the Office of Education, 
the Plan of Operation included a team of three outside evaluators who were 
made responsible for the design and implementation of an evaluation plan to 
measure the effect of the Institutes and the Training Program experiences on 
the participants involved. The evaluation plan was intended to guide pro- 
gramming and to determine the (degree of effectiveness of major elements of 
the total .program. ^ 

The application of the CIPP evaluation model\ developed at Ohio State 
University, to the OLN program by the Evaluation Team required a, variety of 
skills to evaluate both process and product. The broad vange of skills 
required to satisfy the evaluation requirements in the Plan of Operation in- 
dica1>:^d the need for a team, which is consista-.n: vnth the OLN training model. 

'phi Delta Kappa National Study Committe,a on Evaluation (Stufflebeam 
et al .) , Educational Evaluation and Decision Making , F. E. Peacock Publishers, 
Incorporated, Itasca, Illinois, 1971 • 
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The Evaluation Team vitae have been edited to describe the most relevant 
credentials of the-team -nfcers whose conbined skills and experience include 
adult education, human >-elations. organizational development, evaluation, 
library systems planning, regional programming, needs assessment, and 
leadership training. (Sae Appendix E.) 

VI. METHODOLOGY USED AND FUNCTIONS SERVED BY THE EVALUATION TEAM 

A^ Methodol ogy Used by the Evr,liiatinn 
Evaluation is defined as "the process of delineating, obtaining, and 
providing useful information for judgiiig decision alternatives." Since 
decisions must constantly be revised in the planning process so. too. must 
evaluation be a continuous process of providing useful ai ^ appropriate infor- 
mation. According to the CIPP model, there are four general types of decisions 
which must be made during any meaningful cycle of project planning and imple- 
nientation. These are j planning decisions whirh fiPtPrmino nhj^.^jw^c^ 
set priorities; structurin£jedsJons. which project strategies for the achieve- 
ment of those objectives; ini^lementlng decisions which are involved in exe- 
cuting the designs; and .recycling dec1sion.s_ whereby achievements are measured 
against objectives and a determination is made whether to continue, modify, 
or tifminate a project. 

The CIPP evaluation model makes provision for obtaining evaluative data 
about each of the four types of decisions. Context Evaluation is the exami- 

planning decisions which specify major changes that are needed in 
a program. Planning decisions are of fundamental importance to any program 
and appropriate evaluation mechanisms should be maintained to provide infor- 
mation for the formulation of new objectives or the modification of existing 
ones. MeiTibers of the Evaluation Team met with the Project staff and contrib- 
Er|c "^^^ refinement of the objectives and the change of program' emphasis 



from preparation of docuTients to the development of skills. 

Input Evaluation is the examination of structuring decisions made about 
inethods, content, organization, personnel, schedule, facilities, and buCget. 
They are the means to achieve the ends which have been established as a re- 
sult of planning decisions. Structuring decisions can also result in the 
modification of established objectives as limitations of^ available resources 
to insure their achievement are revealed. For example, the role of the Eval- 
uation Team was redefined at several points during the program and therefore 

4 . 

effected the reallocation of project resources. 

In this project, the major efforts of the Evaluation Team were focused 
on the last two components of the CIPP modeT, mainly Process Evaluation and 

0 

Product Evaluation. 

Process Evaluation is the examination of- imple menting decisions which^ 

^ 

involve many choices regarding changes of ongoing procedures. The making 
and execution of implementing decisions comprise much of .the day-to-day 
responsibilities of operating any program. Documentation Reports and personal 
observations provided evaluative data to support Process Evaluation activities 
These Documentation Reports were prepared by Intern Assistants, feedback teams 
faculty, and staff. . Observations made by the Evaluation' Team during visits 
to institutes and Network Advisory Committee meetings contributed to a number, 
of changes in the implementation of the institute program. Any program such' 
as OLN that follows a high-interactive process model requires open communi,ca-r 
tion between faculty and participants to insure continued relevance of tjie 
learning experiences to the learners* expressed needs. In addition to feed- 
back from participants J process observations of skilled observers are highly 
valued by. most institute trainers, both to provide immediate 'feedback and 

and suggestions, and to collect data for use in the design of future learning 

• • • ^ J 

experiences. The Evaluation Team carried out these functions in accordance 
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with the CIPP model of Process Evaluation. 

Product Evaluation is the examination of recycling decision, which are 
applied to determine the relation of attainments to objectives and to deter- 
mine whether to continue, terminate, evolve, or drastically modify an ac- 
tivity. Product Evaluation was based on data gathered from Documentation 
Reports, participant questionnaires (such as the Post Institute Survey 
Questionnaire, see Appen^dix L). written summaries of action plans, and per- 
s^onal observations by members of the Evaluation Team. These "data are re- 
ported in the Evaluation section (part VII) of this report and for^ the core 
for the report of the Evaluation Team. The planning meetings, advisory 
committee meetings, training sessions, and institutes were-a series of steps 
in a process that was designed to improve library outreach programs in New 
England. The Eval uation' Team recognized that the process included a purpose- 
oful attempt to meet the needs of the participants. This required a flexible 
approach to the design of specific experiences for particular groups. 'The 
criteria against which output evaluation could be made were contained in the 
objectives outlined .in the Plan of Operation, 

^ — Functions Served by the Evaluation Team 
The Evaluation Team performed the following functions in the OLN program: 

1) the Team developed the theoretip^ framework and means by which the program 
objectives couTd be evaluate^/gi ving attention to both process and product 

as defined by the GIPP mod^: 

/ 

2) the Team served as skiLTed process observers in selected program activities 
of OLN throughout th/ iuration of the program for the purpose o'f providing 
data which could.be used as a basis for strengthening the program 'as it 
progressed; 

3) the Team assisted staff . Intern Assistants, and participants in clarifying ' 
the objectives which they pursued in various training activities of institutes; 
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4) the Team was involved ia the development and use of Documentation forms. 
These forms were developed for four major purposes: 

a) to provide descriptive data, about activities which could not be 
observed directly by the Evaluation Team; 

b) to provide information about process evaluation by Intern" Assistants 
for use by the institute staff and the Evaluation. Team; 

c) to provide a practicum experience for Intern Assistants to become 
effective observers and e valuators of group problem-solving and 
decision-making processes; 

d) to provide Intern Assistants with the .opportunity to develop skills 
in self-evaluation as they me^y pertain to their respective roles 

in these group activities; 

5) the* Team aided the participants to understand , and practice evaluation 
. techniques as applied to outreach^ librarianship; - - 

6) the Team responded to the requests of institute staff and some partici- 
pants during institutes and follow-up activities as consultants on 
planning, problem-solving, and evaluation; 

7) * Team jTiembers frequently acted as non-threatening interfaces between par- 

ticipants and staff. o 

VII. EVALUATION 

/ 

A. Scope of Evaluation Program i " ^ 

As of November,' 1972, the. Outreach Leadership Program included fifty/seven 

I / 

"formal" events and an undetermined number of informal events t^at emei^ged 

1 / 

from the considerable number of professional meetings which OLN (partixipants 
attended. Since there was neither enough time nor money to permit members of 
the Evaluation Team to be present at all of these events. Documentation Reports. 
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staff repo.rtSi and correspondence were used by the, Eval uation Team to provide 
the information needed about the various meetings- and workshops, and the 
activities which resulted from them. This multi -faceted approach toward 
evaluation was adopted primarily for two reasons: first, the sheer quantity 
of activities which occurred, sometimes concurrently, militated against direct 
per,sonal observation of them by an Evaluation Team member. Second, the very 
nature of many institute activities does not fit well into discrete quantifi- 
/ able analyses. To^'ntervene in activities solely for the purpose of evalua- 
tion in a group setting could not have been done without danger of invoking 
a decided Hawthorne Effect. The fact that attitudtnal and behavioral changes 
were occurring in real-time to some degree in at least 135 individual per- 
sonalities in different directions and at different rates, illustrates another 
dimension of complexity in the evaluation process. 

This section contains a rejview of the sources of data used by the Evalua- 
tion Te'am and several exhibits !of summarized data. The exhibits and their 
associated descriptions and corjments are grouped in the following sequence- 
Data Sources and Events; 

Participant Selection Criteria- and Demographic Characteristics of Par- 
ticipants, Intern Assistants, and State Coordinators; 
Characteristics of Institutions Represented by Participants and Intern 
Assistants; 

Analysis of Responses to the Post Institute Survey Questionnaire (PISQ); 
The Development of Leadership and Network Maintenance. 
These areas of investigation appear in sub-sections B through F below. Where 
appropriate, the Team has inserted interpretive comments which are intended 
to clarify, amplify, or correlate evaluation info^ation. Observations and 
conclusions which the Team recorded as a result of this project experience 
and interpretation of available data, with recommendations to those agencies, 
O ' ' .. 84 - ' ' 
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institutions, or individuals who may seek to replicate or build upon the 
OLN experience, are contained in Section. VIII. 

B> Data Sources and Events 
The major sources of evaluation data appear as follows: 

1) Documentation Reports written by faculty, Intern Assistants, State Coor- 
dinators, project staff^, and some participants, according to a format suggested 
by the Evaluation Team, the form of which was based upon an instrument developed 

, by Austin Bennett, Community Development Specialist at the University of Maine, 
Orono (See Appendix H); 

2) Workshop Documentation Fjieports written by facufty. Intern Assistants, State 
Coordinators, project staff, and Evaluation Team, written according to a format 
suggested by the Evaluation Team and modified by the staff (See Appendix H); 

3) Evaluation Team Documentation; 

4) Written Staff Reports- (free form); 
5.) Correspondence; 

6) Evaluation Team visi>:s and notes. 

The formal events and sources of evaluation data are summarized below. 
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Quanti ty Event 

3 Network Advisory Committee meetings 

16 Pre-Institute Staff meetings 

4 Planning Cormittee meetings 

6 Workshops 

' 5 Post Institute Staff meetings 

9 Fol low-Up meetings 
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Data Source 

Documentation Reports 
Evaluation Team visits 
and notes' 

Documentation Reports 

Documentation Reports 
Written Staff Reports 

Workshop Documentation 
Reports 

Evaluation Team Documentation 

Documentation Reports 
Evaluation Team visits 
and notes 

Documentation Reports 
Evaluation Team visits 
and notes 



Quantity Event 



Data Source 



6 Communications Team meetings Documentation Reports 

Written Staff Reports 

5 Planning meetings for other activities Documentation Reports 
1 New England OLN Staff meeting- , Documentation- Reports 

_2 Participant Selection meetings Correspondence 

In addition to the six sources of evaluation information which pertained 
to OLN events as described above, the Evaluation Team relied upon several 
other forms and bibliographic sources for data which pertained to the back- 
ground, distribut-on, and characteristics of the Participant and Intern 
Assistant populations. These sources include Participant Applications and 
Personal Data Forms (Appendix I ),.activity^^ttendance records, state library 
annual reports, and population statistics. These data are displayeo and dis- 
cussed in sub-sections C and D below. 

The primary sources of information used by the Team to study the effec- 
tiveness of the institutes are derived from direct participation of the Evalu- 
ation Team, notes. Workshop Evaluation Questionnaires, Summaries of Action 
Plans written by the participants', and the recorded responses to the Post 
Institute Survey Questionnaire (PISQ). These data are discussed in sectioa 
E, below. 

Behavioral objectives I and II are the criteria against which responses 
to the PISQ were compared. The degree to which the Evaluation Team f^sls 
that behavioral objective III has been "met. is discussed in sub-section F. 

Those evaluation sources which are documents were designed by several 
groups or individuals at appropriate chronological points throughout the life 
of the project. These designers include- the Project Staff, Evaluation Team 
members, and several planning committees composed of Intern Assistants, 
community leaders, state library agency representatives, and others. Other. 



information sources suchxas maps, library statistics, and the like were ob- 
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tained from general sources such as 1970 census data and institutional sta- 

ti sties. It should be notedv that the primary source documents contain well 

over 2000 sheets of paper which were examined by the Evaluation Team members. 

C. Participant Selection Criteria and Demographic Characteristics 
of Parti CI cants-, Intern Assistant s, and State Coordinator^ 

• 'J — - — lit 

1. Participant Selection Criteria 

The participants are analysed in terms of selection criteria presented 
as part of the Plan of Operation, This working document was used by the 
four Institute Planning Committees to serve as a guide for determining the 
selection criteria for each of the four institutes- The base criteria con- 
tained in the Plan of Operation are summarized below. 

The Plan of Operation states that candidates who were to be considered 
as participants in the four Institute programs should provide prior evidence of 

a. interest and/or responsibility in outreach services in one or more 
libraries or library agencies; 

b. influence and/or authority to be able to anticipate aqtual endorse- 
ment of outreach planning in their library or agency; 

c* wiljingness to involve themselves in the preliminary stages, full 
time in the workshop itself and in the follow-up activities; 

d. library training or experience necessary to provide a common context 
for a learning experience. 

Alternate participants were identified using the .same criteria to provide a 

full complement of attendees at each institute. 

Subsequently, each of four Institute Planning Committees modified these 

base criteria. Specific selection criteria for partlcipcnts of each institute 

are summarized" below, v 

Rhode Island : 1, Action commitment 

2, Willingness to reach out to other librarians 

3, Potential for effecting change 

4, ^ Representation from different sizes of libraries \ 

5, Representation from different geographical areas 

6, Public librarians and those working with public librarians 

at the state level 
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Massachusetts 



7. Diversity of interest- groups 

8. Regional coordinators may be participants 

9. - Membei«: of the planning committee may be participants 

1. Potential for effecting change 

2. Community's need for a program 

3. Commitment to concept of outreach 

4. Commitment to action " 

5. A generally skil led .person with the capacity for growth 
D. Geographical representation 

7. Knowledge of "target group" 



Connecticut; 



Northern States 



Those best able to effect change, best adapted to diagnose 
needs, & most interested in developing & implementing 
successful programs 

Those who can engender community enthusiasm for action 
programs 

State and regional library staff menbers should be 
allowed to participate 

4. Insure geographic distribution (suburban vs. urban, 
low vs. high income areas,, etc.) 

5. Those who are aware of library end community problems, 
want to.be an agent of healthy change, and who will " 
benefit from the institute 

6. Those with a capacity for self-development 

1. Participants with leadership potentiality, both obvious 
and hidden 

2. Geographical spread 

3. Representing "various size libraries 

4. Commitment to implementing action programs 

5. "Public" librarians at local, regional, and state levels 
b. New participants in outreach institutes (not former 

attendees) 

7. " Representatives on the planning committee 

It can be readily observed that the sense of most of the basic criteria 
as expressed in the Plan of Operation "was preserved. by the four Institute 
Planning Committees. The basic differences appear to be duetto a need for 
greater specificity of criteria, specific group or population representation, 
personal commitment and leadership, and a knowledge of the existence of 
specific unreached groups in each state. 

In«general, the solicitation and screening of candidates according to 
the specific criteria were accomplished by the four Institute Planning Com- 
mittees; final selection was made by the Project Director with the advice 
end consent of other individuals as needed, including the staff team for 
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parti\cular institutes and instate Intern Assistants. 

This process resulted in the selection of 113 participants. Similar 
;)rocedures and criteria were used to select fifteen Intern Assistants and 
six State Coordinators, prior to the selection of participants. Individuals 
who participated in the two Training Programs were' selected by the Project 
Director on the basis of previous institute experience, interest, and 
availability. 

2. Demographic Characteristics of Participants, Intern Assistants, and 
State Coordinators 

Certain characteristics of the resulting institute population are quan- 
tifiable. These include age, sex, income, geographic distribution, and pre- 
vious participation in similar institutes. Supplementary information about 
the characteristics of the institutions from which participants were selected 
include size of population served, library holdings, and a gross measure of 
the use made of the material resources of each institution. These data are 
displayed in Exhibits 1 through 8. It should be note-J that these data reflect 
the characteristics of participants. Intern Assistants, and State Coordinators 
who attended the four Institutes and two intensive Training Programs. 

The following' demographic data is summarized from information derived 
from the Participant Applications .and Personal Data Forms (Appendix I) and 
refer to Exhibits 1 through 3. 

Age : In general, the population can be characterized as middle-aged, 
only 0.4 year separating the mean age of the staff from that of the 
participants themselves. The median difference is 2.0 years. The age 
span of participants was 24-70, or 46 years; the comparable range for 
staff was 28-60, or 32 years. There were no participants below the age 
of 24, a normal expectation, since that is the earliest probable age' 
which a professional librarian with an MLS and' at least one year's full 

time job experience could attain, although the degree was not a formal 
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requirement for OLN participation. 

Sex : 24% of the p.artici pants and 33% of the staff were men. 
Salary ; The wide annual salary range of participants ($300 - 16,240.) is 
partly due to the 'act that fourteen of the 113 participants ctre part- 
time employees which appear in the low end of the scale^.''f^o attempt was 
made to equalize salaries on a full-time annual basis. 

Participants ■ Staff Participants + Staff 

Mean Salary $-8,834 $10,360 $9,015 

Median Salary '$ 9,000 ^ $10,900 $ 9,022 

Salary Range $ 300-16,240 $3,j307-14,150 $ 300 - 16,240 

SUMMARY OF DISTRIBlrnON OF -PERSONNEL BY GROSS SALARY 

EXHIBIT 3 

G eographic Distribution ; The map in Exhibit 4 displays the resident 
cities from which participants ^ Intern Assistants, and State Coordinators 
were drawn.. The location of the site for each institute is also labeled. 
In the case of Rhode Island, Massachusetts, and Connecticut, participants 
■ attended the Institute held within thj^ borders of their state of residence. 
Participants from Maine, New HampsTiire, and Vermont attended the Northern ' 
states Institute in Durham, New Hampshire. 

It is reasonably evident that the population was biased neither 
toward urban nor rural centers. The active participation of one librarian 
from Fort Kent on the Maine-Canadian border in more than formal workshop 
attendance is encouraging, since round trip travel over that distance is 
approximately 750 miles. 

The selection criteria for a reasonably wide geographic distribution 
was met. Although the participants were constrained to attend OLN 
activities within their state borders, a conscioui, effort was made -to 
foster interstate person-to-person communication within the Intern Assis- 
tants group and at the second Training Program. Three maps (Exhibits 5 
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•through 7) plainly reveal the positive results of this approach. Every 
institute used the services of Intern Assistants from at least one 
other state; . ' a i 

, Participation in Institutes other than OLN : Nine of the 1V4'0LN parti ci- 

V.. • 

pants have attended institutes pnoK^to the OLN program. Threerbf these, 
and nineteen of the Intern Assistants and State Coordinators attended 
outreach institutes pither at Springfiel-d, Massachusetts in.vl970 , or at 

-. Bates' Cqilege, Maine ^.yi 1971,, both of whjch v?e re federally sponsored ^ 
programs adminiatered by the same faculty.. Therefore", forty-dne,\pr 31%, 
of the paniciparits and staff had prior inst-itute experience. Thes.e 

. people -^form Ihe nucleus. ■.gnoup..;from^;which;^ OLN Intern Assistants were ^ 

selecte'd. This strategy provide'd for'building upon earlier experiences 

to increase and extend thv^ competence, coifimi'tment, and impact •of this 

- core group \in the.pu6li£ library community in New England... 
. -l " ■ \-- 1 • ' ■ ■ . ■' ■ ' '■ ■ \ 

d:- 'characteristics; "gf Institutions Represented by participants and Intern 
Assistants* ^" ■ . ' I*. 

Information about the characteristics.._of^-the institutions from. Aflhich 

participants and Intern Assistants were drawn are displayed in Exhibit 8.,' - 

It. should be noted that agencies which have state and sub-regional, resppn- 

sibiLities are omitted ^from this tabul cation , ""since their inclusion could be 

equated with the total population of New England and obscure the data. " The 

data used were obtained from annual! and biennial reports of state "library 

agencies and the 1970-f9'7.1 edition if Ameni can Library: Pi rectory . 

Population : The total. ^«populati on of- potential users of the .libraries 

represent by the participants and Intern Assistants^ is approximately 

3,600,000 , persons . The largest l i-brary serves a potential user popula- 

tion of 641 ,0/.1; the smallest serves 396. The ratio. of outreach staff 

■to population is very wide indeed., and indicates the. degree of difficulty 

to which interaction between the library outreach staff and its patrons 



EXHIBIT 5 - 
Distribution of Staff for the 
' Three Southern Workshops 
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EXHIBIT 7 

Disr' ution of Participants in 
•3 iinihg Program II 
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can be achieved* 

Holdings : Although library holdings expressed as volumes owned is an 
inaccurate measure of available library resources because resource quality 
is omitted, these figures are usually considered as one indicator of 
library size and resource strerfgth.. The range here is 2,842,903 to 
2,642 volumes. 

Circulation : Items circulated per year is also an imperfect measure of 
user interaction with library resources, since only one library service 
is revealed* The largest circulation figure recorded is 2,567,378 per 
year and(^the smallest is 1 ,295. The over-all mean and median are 
192,514 and 106,288, refspectively . 

Taken together, these data show that the participants and Intern Assis- 
tants represent a very wide spectrum of library sizes, geographic dispersion, 
physical resources, and bibliographic interaction with constituent populations. 
The value of this information, particularly the population data, will assume 
reasonable utility if longitudinal studies are made of the impact of outreach 

■ \ 

activities and programs generated through the OOtreach Leadership Network. 
Other data directed toward that end which has not been summarized in this 
report could include outreach staff/user population ratios as an indication 
of outreach effectiveness,, similar to the *'case-load" per person indicators 
developed by social agencies. 

E. Analysis of Responses to the Post Institute Survey Questionnaire (PISQ) 
The PISQ is one of several basic instruments developed and used by the 
Evaluation Team to determine if certain behavioral objectives were met. Part 
A of the PISQ was devoted to collecting information about the process of action 
planning; Part B was' concerned with the parti ci pants ' view about selected 
skills which, the Institute experience -- particularly the v/orkshop segments ~ 
were intended to impart. The responses to the PISQ are tabulated in Exhibits 
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12 and 13. The results of the tabulations are discussed below, as they re- 
lated to the behavioral objectives and abilities as defined^by the Project 
Director. 

Where appropriate, the Team has supplemented the analysis of PISQ responses 
with other data sources, such as action plan summary reports which the partici- 
pants have submitted to the OLN staff. Exhibit 9 below displays the rate of 



action plan reporting on a state-by-state as well as institute basis. Dis- 
cussion of the PISQ 'and action plan responses are included in this section. 

Meaningful behavioral change analysis requires gathering appropriate 
data by unobtrusive means: in some cases, this technique has also been used. 
In the case of the PISQ^ we are, however, limiting our observations primarily 
upon what the participant says ,^ rather than upon what he or she does . Further 
comment upon observed behavioral changes on the part of the participants and 
the institute staff members are noted where they have occurred. 
1 . Procedure 

The PIS0 was .developed by the Evaluation Team from appropriate sections 
of the original Plan of Operation which referred to go^ls, objectives, and 
skill development. A draft questionnaire was formulated and distributed to 
selected participants and the staff for reaction and comment. After the 
commentaries were cotlected, the Evaluation Team made appropriate changes 
and then distributed the PISQ as, reproduced in Appendix L. 



EXHIBIT 9 

RETURN RATE OF ACTION PLAN SUMMARY SHEETS 
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" The PISQ was distributed on the same date to all participants. This- 
approach to this part of the evaluation process was intended to help identify 
factors, which, either alone or in combiijation with other evaluation data 
elements, might shed some light upon the effect of holding institutes at 
different times of the year and in different parts of the region. It was also 
assumed that some information about the relationship of elapsed time to stages 
of implementation of action plans could be revealed by this technique. 

The relative chronological distance between the last'ds^y of each institute 
and the mailing date of the PISQ is displayed below in Exhibit 10. 

EXHIBIT 10 

ELAPSED DAYS FROM WORKSHOPS TO PISQ DISTRIBUTION 
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The Summary of Responses to the. Post Institute Survey Questionnaire: 
Part I, General Data (see Exhibit 11) displays the dates during which the 
four institutes were held,, the dates which the PISQ was distributed, the 
PISQ return deadline, and the distribution of the quantity of responses across 
the six New England states. 
2. Response Rate 

Selltiz et al_^ observed that "when questionnaires are mailed. to a random 
sample of the population, the proportion of returns is usually low, varying 
from about ten to fifty per cent." (p. 241). Selltiz further asserts that 
factors which affect the response rate include the length of the questionnaire, 
the credentials of the questionnaire sponsors, questionnaire format, ease of 
responding and the characteristics of the people receiving the questionnaire, 
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the mobility of the recipients, and follow-up activities by the questionnaire 
administrators vis a vis non-respondents. 

Maurice Line, on the other hand, observes that: "In a compact conmunity 
(like. (sic) a university, a response-of seventy or eighty per cent or even 
higher can be hoped for; if the ordinary public are to be sampled, the response 
may be as low as forty per cent." (p. 31). 

The PISQ was not sent to a random sample of the population as a whole, or 
even a random sample of the participants - all participants were sent a PISQ. 
The return deadline was twenty-one days after mailing, after which a reminder 
letter was. sent. A stamped addressed return envelope was distributed with 
the original mailing. Anonymity of respondents was attempted by means of 
coding the questionnaires, but the coding technique did- not assure such 
anonymity. This fact could have inhibited some respondents from replying. 

The response rate of 50 .'5% is within the boundaries suggested by Selltiz 
ond Line. The target community was neither compact (in Line's sense), nor 
was it drawn from the population as. a whole. The Evaluation Team would have 
preferred at least a 60% response rate, but given the time of year a heavy 
vacation period - the Team feels that the quantity of responses does provide 
enough data for reasonably useful analysis. 

The relationship of questionnaire response rate to the distance in time 
from a workshop, as displayed in Exhibit 11, is not unexpected. All ques- 
tionnaires returned by participants from the first three workshops are above 
the mean percentage response rate for all states. The frequency of responses 
from participants in the three states which formed the Northern States Institute, 
taken as a g'roup, was lower (40.6%) in comparison to the participants in work- 
shops held previously (50-57.7%). The Northern States Institute was the last 
of the four institutes held. 
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3, Format 

With respect to the responses to the Post Institute Survey Questionnaire, 
opportunity was provided for respondents to express themselves in short 
descriptive phrases in PART A: ACTION PLANNING , because the evaluators did 
not want to close off free expression or pre-judge into which categories 
responses should be grouped. This technique created some problems for the 
Evaluation Team in the quantification of results, but allowed the respondents' 
"questionnaire" personalities and attitudes to show through. 

Since free text responses were encouraged, some judgment about how 
responses could be clustered was made by the evaluators after the responses 
'were received. This procedure was necessary in order to construct continua 
along which responses could be quantitatively distributed. These continua are 
displayed under each question in Exhibit 12. The Evaluation Team was also 
interested in discovering if there were any observable differences in response 
patterns from participants involved in different institutes. It was also 
hoped that responses from those participants from the three northern states 
who attended the same workshop could serve to help isolate differences between 
state groups which had been exposed to much the same workshop, experiences . 
There is some risk in "the latter course because there were only twelve ques- 
tionnaires and three letters returned from the northern tier states: equiv- 
alent to 33% of the questionnaires distributed. Three responses each from 
New Hampshire and Vermont participants do not, after all, provide enough 
points to discern meaningful patterns. The responses to Part A are discussed 
in conbi nation with the responses to Part B., beginning on page 113. 

The second half of the PISQ is entitled PART B: PERSONAL SKILLS ASSESS- 
MENT . This cluster of questions .was specifically intended to provide rea- 
sonably quantifiable data along a five point continuum. The proportional 
distribution of responses to the twelve questions are displayed on a series 
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of bar ratios for each workshop for comparison purposes against the average 
ratio for all responses to a particular question. These bar ratios are 
displayed beginning on page 110. 
4. Discussion 

The first behavioral objective, as restated in section IV above (see also 
Appendix A), asserted that: 

(I) "Participants will be able to formulate a community-based action 
program designed to extend library services 'to specific target groups i-n- 
their community which they determine to.be inadequately served." 

This objective was to have been met by means of developing and applying 
the following skills or abilities as formulated by the Project Director: 

1. Ability to define "community," "inadequately served," and "target 
group;" 

2. Ability to involve the community in gathering relevant data about 
the needs in the community; 

3. Ability to define community issues and describe potential target 
groups (....); 

4. Ability to select a target group; 

5. Ability to work through a prescribed problem-solving process at the 
institute to develop an outline of an action program directed toward 
a specific target group; 

6. -Ability to revise and modify the proposed action program after the 
institute ty means of involving menfcers of the selected target 
group (...). • - 

The second behavioral objective, asserted that: 

(II) "Participants will be able to implement a community-based action 
program designed to extend library services to specific target groups in the 
community." This objective was to have been met by means of developing and 
applying the following skills or "abil it.ies as formulated by the Project Di recto 

1. Ability to relate present and potential library services to respond 
•to community issues; 

2. -Ability to discover and use relevant resources in implementing the 

acti.on plan; 

3. Commitment to library outreach concepts; 

4. Ability to work with groups (...) in order to facilitate their 
co!;imuni cations and decision-making in re the action program; 

5. /"jjility to seek alternative ways of implementing the action plan in 
response to new data that becontes available before and during the 
implementation stage. 
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^ The third objective is discussed in section F, Development of Leadership 
and Network Maintenance , 

The first behavioral objective is concerned with the process of formu - 
lating action plans; the second objective is addressed to implementing them. 
Although a set of discrete skills was written under each objective by the 
Project Director, there is a cyclical process of formulation, partial imple- 
mentation, and reformulation which continues throughout a dynamic action 
program — a kind of dialectic form of change. The Evaluation Team has not 
attempted to isolate formulation from implementation processes into separate 
boxes, but rather to combine some of them in PISQ questijDns which can be re- 
vealing from either vantage point. Some skills are quite obviously concerned 
more with one particular process than another, but in many cases, it is more 
a question of emphasis. In the last analysis, if an action plan has been 
implemented well, it has probably been formulated well; conversely, a well- 
formed action plan has a better than even chance for successful implementation 

The behavioral objectives .and their associated skills are discussed below 
in terms of their relationship to questions as they appeared in the PISQ. 
Then, information which was elicited by the PISQ but which has "tenuous rela- 
tion to either objective is noted. A note about;, the action plan summaries 
which a majority of participants submitted to the project office and their 
relationship to the objectives and skills follows. Finally, profiles of 
each institute are drawn, based upon the responses to the Personal Skills 
Assessment section (part B) of the PISQ. 

OBJECTIVE I ...formulate a community-based action program... 

(see Appendix A for full texts of objectives & associated abilities) 

The degree of attainment of. the first of three objectives was to be in- 

dicated by evaluating the process which participants acquired and applied 

specific skills during the four institutes. They were combined in several*' 

^ w^^ys and reduced to questions on the PISQ. It was intended by the Project 

ERIC . 



Faculty that six complex abilities would be developed and applied toward 
the attainment of this objective. All PISQ questions in Part A except #7 
revealed to some degree the level of skills applied by participants in'the 
process of Action Planning. In the Personal Skills Assessment (Part B), all 
questions except numbers 2, 6, and 11 applied. 
Objective I Ability 1 

No single PISQ question was explicitly directed to the question of de- 
fining "community, "."inadequately served," or "target group" (Objective I 
Ability 1). The Evaluation Team determined that understanding of these con- 
cepts was embedded in the successful application of other abilities. These 
concepts were addressed as a secondary concern in questions Pt. A: 1, 2, 3 
and Pt. B: 1 and 4. Since 9U of the respondents identified "unreached 
groups" (a synonym for "inadequately served") by observation and/or community 
interaction, by defining non-users, and by being approached by members of the 
target group in the community, it is a safe conclusion that those persons 
which formed the target group were abstracted from the library's community 
and were, by definition, served inadequately according to standards of service 
peculiar to a particular participant or his library's policies. PISQ Part A 
questions 2 and 3 show that 77% of the respondents have involved the conmunity 
members and target population and question 3 indicates that 79% have involved 

4 

Other corranunity representatives in both planning and needs assessment. The/" 
responses to Part B questionsl and 4, which/dealt with target group identifiV 
cation skills and the .assessment of community nefeds, indicates that about W% 
of the respondents acqui|id techniques to support the definition process as 
a direct result of the iy^titute program. There appears to be adequate basis 
for asserting that a reasonably high percentage of the respondents did indeed 
develop operational definitions of the three concepts illustrated in the 
first ability under Objective I. ^ 

'*» 
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Objective I Ability 2 

The first three questions of Part A and the eighth question in Part B 
of the PISQ' are primarily designed to elicit responses about the ability of 
the participant to involve members of the library's community in gathering 
data about community needs. Other questions of secondary relevance to this 
objective include* numbers 5 and 1,0 from Part A; numbers 4 and 5 from Part B. 
The skill in identifying unreached groups (Pt. A. 1), involving the target 
population and other members of the community in needs assessment and project 
planning (Pt. A. 2 and 3), and applying the skill of discovering and using 
community resources (Pt. B.'7) form the core requirements which should be 
attained by participants. 

An examination of the responses to questions Pt. A 1, 2, and 3 indicate 
that at least 77% of the respondents felt that these skills were applied. 
81.6% claimed that at least "some" skills were acquired (Pt. B. 7) which 
contributed to the attainment of the objective. 
Objective I Ability 3 

Three PISQ questions were primarily concerned with the ability to identify 
community issues and to describe potential target groups in the community 
(Obj. 1,3). These questions asked how unreached groUps and community repre- 
sentatives were identified and involved by the participant (Pt. A. 1 and 3; 
Pt. B. 8). ■ 

Three other questions relating to involving members of the target 
population (Pt. A. 2), isolating objectives and the needs which these objec- 
tives satisfy (Pt: A. 5), and skills in planning (Pt. B. 1) are secondary 
skills which contribute to the satisfaction of the third ability under 
Objective I. ' ' 

The responses to both clusters of primary and secondary questions are 
illustrated in displays of the above questions and again point to predomi- 



nantly successful acquisition of these skills. The Community Survey 
Questionnaires (Appendix J) also reveal a reasonably good indication that 
some major community issues were identified by this means by the partici- 
pants who used them. It is interesting to note, however, that although almost 
all participants completed Community Survey Questionnaires (CSQ), n.o respondents, 
mentioned the Survey- as a primary means for identifying unreached groups 
(Pt. A. 1) or- needs assessment (Pt. A. 2). 
Objective I Ability 4 

Of the five PISQ questions which pertain to this objective, only the 
first question of Part A was considered of primary importance as an .indica- ~ 
tion that a target group was selected as a result of the use of the CSQ. At 
least 78% of the respondents said that community interaction or observation 
was the means used to identify the target group. Target groups were selected, 
however, without expressed arbitrariness and the community was involved 
(Pt. A. 2, Pt. B. 1,4, and 5) in a group decision-making process. 
Objective I Ability 5 ' 

Eleven PISQ questions were directed toward discovering whether or not 
the participant has demonstrated the ability to work through a prescribed 
problem-solving process at the workshop which resulted in an outline of an 
action program directed toward a specific target group (Obj. 1,5). The pri- 
mary PISQ questions are Pt. A. 4, 5, and 8 and Pt. B. 1 and 10. Secondary 
questions which are applicable are pt. A. 6, 11, and 12; Pt. B. 4, 7, and 9. 

About 27% of the respondents could articulate the role of "helper" in 
. the triadic approach to group problem-solving and an additional 36% could 
■ describe it briefly. Therefore, 63% of the respondents were able to recall 
at least part of this technique. Almost 90% of the respondents could 
articulate and distinguish between objectives and needs as expressed in their 
proposed outr-each projects. Twenty-five respondents replying to Pt. A. 8 

erJc 
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said that they were involved in developing or implementing action plans 
other than outreach, which, at the very least, serves to reinforce the appli- 
cation of problem-solving techniques, whether the techniques were learned 
as a part of the OLN program or not. 

The fact tha^t nineteen action plans had been implemented (but not 
necessarily completed) at the time of the PISQ distribution means that problem- 
solving techniques had been applied successfully. An additional seventeen 
plans were en route toward implementation. These data indicate that about 
32% of the participants had made significant progress toward action plan im- 
plementation, using problem-solving techniques after the conclusion of the 
institute series. 

Of particular importance in the context of this ability is the bar 
graph summary of Part B question 1 of the PISQ. Fully 88% of the respondents 
from all institutes asserted that. at least "some" skills in problem-solving 
were acquired as a result of the institute experience. 

The workshop technique (Pt. B. 10) was found to be a useful cluster of 
skills for many respondents, since 81.6% of the responses selected "some," 
"many," or a "high" number of skills learned. 

The results of the secondary questions and their relationship' to the 
application of problem-solving skills can be deduced from the exhibits 
al luded to above. 
Objective. I Ability 6 

Fourteen PISQ questions were concerned with the development of the 
participant's ability to revise action plans after the institute by involving 
target group members in the decision-making process. The responses to four • 
of these (Pt. A. 2, Pt. B. 3, 5, and 9) are primarily pertinent to -the com- 
plexity of skills, while ten others are of secondary impact. 

Part A, question 2 indicates that 60% of the respondents were able to^ 



involve menfcers of the target populations in needs assessment and project 
planning to a high degree. 

In Part B, we learn that the acquisition of conmuni cation sk.ills {nZ) > 
skills in working with the target population (#5), and skills^ in writing action 
plans (#9) was solid. One can reasonably infer that these skills, taken 
together, form a highly complex interactive process which underpins successful 
action plan implementation, particularly if such interaction and coordinate . 
decision-making on a person-to-person basis continues and is enhanced through- 
out the life of a program. 

" OBJECTIVE II ...implesnent a community-based action program... 
Objective II Ability 1 

The first ability to be developed by the OLN institute program as one 
means toward implementing a community-based library outreach action program 
is to relate present and potential library services to satisfying. target . 
group needs which are manifested in community issues. 

The PISQ contained six questions concerned with the relationship of 
services to needs. They are in Part A, questions 2, 6, and 10; and in Part 
B, questions 1, 4, and 11. The responses which are most pertinent to the 
point are contained in Pt. B. 4, where 71.2% of the respondents felt that 
"some," "many," or a "high" number of skills, were acquired to cope with 
, this activity. 

The responses to the secondary questions (Pt. A. 2, 6, and 10; Pt. F. 
1 and 11), with respect to this particular ability, are concerned with in- 
volvement of the community in needs -assessment and planning, the stages of 
action plan ^implementation, personal references to community members who 
could vouch for a particular program's impact, problem-solving, and imple- 
mentation strategies. 

The best proof of the attainment of this complex skill should be 
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entedde'd in the action plan itself, and more will be said about this point 
later in this section* 
Objective II Ability 2 

Of the eleven pertinent questions in Parts A and B of the PISQ, the ' 
responses to questionis B: 7 and 8 are of primary importance to determining 
if skills to define, discover, and use relevant material and human resources^ 
were acquired by the participants. As a group, the participants indicated 
that no one found that he/she acquirejl a high number of skills in defining 
and using material resources, but fully '57% signified that ei^ther "some" or 
"many" skills were acquired.- It is significant that over 18% "none" "nswers 
were written by respondents to this question — the highest "none" category 
for the entire PISQ. Furthermore, responses to Pt. B. 8 ( human resources) 
•show that only 2% (= one person) felt that no new skills were acquired, while 
70% wrote that "some," "many," or "high" numbers of skills were acquirrjd. 
Objective II Ability 3 

Four of the eight questions in the PISQ were highly pertinent to deter- 
mining if commitment to library outreach concepts has been developed within 
the participant group, even though such commitment cannot really be determined 
within the time span covered by the formal OLN program. A longitudinal study 
is the best means to determine that, but some early indicators are already 
visible. The fact that nineteen participants have initiated action programs 
means that -they have been tenacious enough to see their own plans through; - 
seventeen more are climbing the ladder (Pt. A, 6). Fully 48% of the respon- 
dents are in charge of their own projects and assure the reader that the 
projects will continue even if the participant leaves his/her job. Moreover, 
an additional 20% claim that although someone else is directing the program 
it too would continue under the same conditions (Pt. A, 7). 

These observations, coupled with the fact that 87% of the respondents 



would allocate more resources^to outreach in their libraries as a' result 
of participating in the OLN program, if they had control of those' re- 
sources (Pt. A. 9), signify that both the participants and the institu- 
tions which comprise these encouraging responses are well along toward 
good commitment to outreach. More will be said about this important effect 
of OLN in section F below. 

Objective II Ability 4 

The ability to work with groups in order to facilitate clear communi- 
cation and decision-making with respect to implementing actio^i' plans and 
programs i's a major ability which ^the entire OLN program was dedicated to 
developing in everyone concerned. Practically every activity was group- 
centered: f)f the twenty-four questions in the Post Institute Survey 
Questionnaire, sixteen were in some way related to group activity. Five 
of the sixteen questions were particularly relevant: Part B: 2, 3, 6, 
10, and 11. These include the ability to be articulate, helpful to 
others, give and receive ideas, sell and implement action plans, and 
translate workshop techniques into the! local conmunity situation. Taking 
the "many" and "high" categories in Part B of the Pos-t Institute Survey 
Questionnaire for each of these questions, it can be observed that over 
35% of the respondents felt that important and visible new skills had 
been acquired which contribute to the development of this ability (Psrt B, 
question 11). If we lower the boundary to' include the "some" level of 
skills, the percc-ntage for the same question jumps to 77. A similar 
pattern, but even more dramatic, raises the percentage to -90.6 (Par^ B, 
question 3) when coiranuni cation skills are examined. 
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Objectiv/e II Ability 5 

✓ 

The development o.f the ability to seek alteVnative ways of implementing 
action plans, in response to new data* that becomes available before and 
during the implementation stage -is touched upon in the responses to nine 
of the twenty-four Post Institute Survey Questionnaire questions. Three 
of these relate directly fb this ability. Part B question 11 explicitly 
copies the wording of this ab'il.ity, ind responses to it show that at least, 
a few skills .were acquired by at least 96% of the responaents. Question 
12 in Part B is concerned with evaluation* and program effectiveness by 
means of comparing objectives agaiiist progress, then making suitable 
changes if necessary throughout the implementation schedule. The same 
percentage, 96, indicated positive skill acquisition. 

;The third question in the Post Ins^tu^te^urvay-Ques'tTor^ concerned 
.primarily with the development of .this ability is Part A^question 6'. -Ihis 
question requested the participant to date each of :si;x milestones through, 
which his/her action plan has passed until it was finally imjDlemented. 
The second milestone is labeled "plan revised.". Twenty-four of the thirty- 
six respondents-^whojiad^^ plans had reached 'the 'prede- 
cessor milestone had .^1 ready passed thrmIgR~^frg^reTi'S*io si'fage] Pre-^^^^ 

» 

sumably, such revisions are found to .be necessary as each milestone is 
passed. This is the normal course of events when plans, or proposals, 
are shepherded through an approval sequence. It is also obvious and 
natural that more plans have^IfeBn^-app^noitedwhich were generated from early 



institutes than later ones, 



/ 



There is little doubt in the minds of the Evaluation' Team that, as" best; 
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. as we can tell, the first two behavioral objectives have been met by the 
OLN program, if what the participants themselves have told us by means of * 
the PISQ turns out to be true in terms of actual rather than verbal behavior. 
. To supplement the responses to those questions which are close to tlie wording 
of the eleven abilities tested under each behavioral objective, the Team 
asked two additional questions. These appear in the PISQ in Part A as 
questions 11 and 12. 

Question 11 asked the participant to describe major problems which he 
•^had encountered in developing and implementing his action plan. The responses 
indicated that lack of time (or poor timing in the year), lack of money, red 
tape and lack of personnel and staff encouragement were the areas of greatest 
frustration, ^tost of these barriers can be overcome if personal and institu- 
tional commitment are strong enough.- It is significant that most barriers 
.were seen as external to the participant himself; only two respondents indi- 
cated that they either could n6t develop a project or, at that point in time 
at least, that their objectives were unrealistic. One could argue that -any 
action plan which "cannot" be imp.lemented has unrealistic objectives in the 
first place; or involves people who lack the necessary skills to perform 
the tasks. • 

Question 12 in Part A was addressed to the "spin-off" benefit of skills 
acquired during the insti'tute series. Most of the skills of problem-solving, 
writing action plans and the like can. with a little imagination, be trans- 
ferred to socially useful activities other than outreach. Of the 53 respon- 
dents to this question. 66% emphasized the utility of the skills acquired 
wffich related to interpersonal relationships and,group dynamics. This 
response pattern fits Objective II. Ability 4 (the ability to work with 
'groups) nicely. 

In general, it seems that a significantly high percentage, over 53%. 
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of the action plans developed as a direct result of the OLN programs have 
at least been implemented, and 57% of the total participant group have re- 
ported summaries of action plans in various stages of development (see also. 
Exhibit 9, page 99 ).. These facts alone reflect a very good activity level 
of outreach programming in the region, and provide further justification to 
conclude provisionally that Objectives I and II appear to have been met. A 
longitudinal study some months hence would provide a much firmer foundation 
upon which to make a final judgement about the OLN program as it pertains 
to product evaluation as defined in the CIPP model. 
5. Personal Skills Assessment 

Part of the PISQ has already been discussed above, but some special 
comments should be made about its utility, and what differences can be 
observed among the four institutes. 

The bar graphs displayed from page 110 through 112 indicate a spread 
of responses to twelve questions about personal skills development among 
the participants over a five-point scale, or continuum. As might be expected, 
since a "neutral point exists in an odd-interval scale, most of the responses 
fall around the middle point. In this case, the scale ranges are high , many , 
some, few, and none . The scale is, therefore, biased toward positive re- 
sponses since some is not a truly neutral word. If symmetry of negative- 
positive scaling were vigorously imposed, an interference category such as 
"I lost skills" would need to be applied. But the Evaluation Team felt that 
this approach was not applicable since it can be reasonably assumed that all 
skills learned, or at least improved, were positive rather than negative 
ones. Such an approach would have been analogous to asking, "What bad skills 
did you acquire as a result of your institute experience?" 

In general, then, we should be most interested in the participants* 
perceptions about the skills which they acquired (as defined by the PISQ) 

- 123. - 



which are grouped at the extreme ends of the scale, e.g. "nigh" or "none." 
It is in these categories where improvement in the OLN program can be made. ' 
The distribution along the scale is symmetrical and bell-shaped; 4.8% "high" 
and, 5.2% "none." The overall responses which account for the major portion 
of the "highs" are found in Question 1 (7.5%), 2 (7.5%), and 9 (9.4%). ' 
Question 7 received no "highs" at all and a reU'tively large percentage of 
"none" votes (18.4%). The "none" category, which reflects an attitude that 
no new skills were learned occurs in a most pronouncsd fashion in questions 
4, 6, 7, 9, and 11. Participants which indicated unusual frequencies of 
responses on the extreme points of the scale attended the Rhode Island and 
Northern States Institutes. The Massachusetts Institute participants pro- 
vided-the largest percentage of "highs" for any one institute as evidenced 
in their replies to question 9 (21.4%). 

Some general observations about the responses to each question follow. 
Question 1 - skills acqui red in the planning process ranked relatively 
high overall, with 7.5% of the respondents making that claim. The Northern 
States Institute participants account for the lion's share of that figure, 
since 16.7% of the NS participants registered "high." Tlie NS group was 
symmetrical in this regard since 16.7% also indicated that they acquired 
"few" skills. Since N=12 for that group, the moverrent of one respondent 
from "high" to "many" can account for a net dhange in the response ratio of 
' 8%. The NS group was generally satisfied with the quantity of skills acquired 
to support the planning process as 'defined by the OLN program. The Rhode 
Island group felt "high" was an extravagant category in which to subsume 
their skill acquisition for this question: no participant indicated "high" 
as a category. 

Question 2 skills in o utreach leadership received a solid 7.5% "high" 
rating .across all institutes. The participants in the first institute, Rho.de 



Island, were the only group which registered "none" (7.7%). All other insti- 
tutes produced a 0.0% for this question. In general, the Connecticut Institute 
participants wei^e apparently helped the most in this area of skills development 
and Rhode Island participants the least. This could be" interpr^eted as an 
Indication that a good many of the skills required to iiiiplement outreach lead- 
ership programs were already known to the Rhode Island group. 

Question 3 ~ skills in communication reveals that the Connecticut and 
Northern States Institutes produced the greatest changes in coimuni cations 
skills according to the participant's own statements. No participant indi.- 
Gated that no_ communications skills were improved. 

Question 4 skills used in assessing community needs : 16.7% of the 
Northern States Institute participants said they received "high" improvement 
here. 15.4% Rhode Isljinders, on the other hand, felt that no skills were 
acquired or improved. 

Question 5 skills of developing working re'^ationships : all parti ci- 
pants generally felt very positive, but middle of the road about this question. 
No one was:outright negative, and Connecticut people were the only ones 
registering .a solid 7.7% "high" rating. All others registered no "highs." 

Question — skills iri seeking support and approval of your project : 
this complex of skills is exceedingly difficult to implement. Northern States 
people, and Connecticut participants to a lesser extent, felt that this area 
of institute activity was quite helpful to them. 

Question 7 — skills in defining and using community resources : this 
question received no "high" responses, and 18.4% "none" responses. 27.2% of 
the Rhode Island respondents felt that nothing was learned to develop these 
skills, the highest "none" response for any question. This pattern remained 
reasonably flat across all institutes, indicating to some degree at least, 
that some additional emphasis may be required in future institutes if they 
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are-designed to provide these skills. This particular skill development 
area was not programmed into the institute series as a separate learning 
/task. When needed, it was handled on a one-to-one basis. 

Question 8 -- skills in di scovering and using human resources : only 
one person -- in the Northern States Institute -- felt that no skills were 
learned. Otherwise, a solid positive reaction is observed. 

■Question 9 ~ skills acqui red in writing action plans : the weakest 
institute in this area was Northern. States , according to the. respondents. 
The 25% "npne" indicator represents only three out of a total of twelve re- 
spondents. Of the total participants 'attending this institute, this three- 
person group is equivalent to only 8%. If the bar ratio is applied across 
all attendees at this Institute, the .number of ^none" responses would be 
nine. It appears that although the actual quantity of "none's" was small, 
a need was not met, unless this particular group of skills was already known 
by members of the "none" respondents. It should be noted that the emphasis 
upon producing a piece of paper called an action plan as a sine qua non for 
each participant was relaxed as time went on. Process rather than product 
became over-riding as an OLN emphasis. 

Question 10 — skills in using workshop techniques : solid skill im- 
provement here. Rhode Island and Northern States respondents were equivalent 

t 

on a percentage basis (9.1%) in terms of the quantity of "none" responses. 
This part of NS was offset to some degree by a 9.1% "high" rating. 

Question 11 — skills in implementing action plans: if "none" and "few" 
responses are grouped together, 23% of the respondents felt a certain degree 
of inadequacy with respect to these skills.- This may be because there was 
not enough time since the conclusions of the Northern States Institute to 
get deeply into action plan implementation; certainly those participants in 
Rhode Island had a much greater lead time to discover the problems of imple- 
mentation. 
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Question 12 — skills acquired 1n evaluating action plans :, it is apparent 
from the general slope of the lines drawn between bar ratio break points, that 
skills acquired for action plan evaluation improved as time went on; the mean 
ratio was matched somewhere between the Massachusetts and Connecticut Insti- 
tutes, and the "none" category disappeared in the Connecticut and Northern 
States Institutes. 

t 

A summary of the spread of responses to Part B of the PISQ from all re- 
spondents-appears below in the left column, rankled in order of the "none," 
"few," "some," "many," "high" continuum. This continuum reflects the quantity 
of skills which the respondents said they acquired. Taking that summary as 
the norm, the spread of responses from the respondents in each institute are 
displayed adjacent to the norm. The percentages have been rounded to the 
nearest integer. 

EXHIBIT 14 

PER CENT DISTRIBUTION OF RESPONSES TO THE PISQ, PA.^T B 



Skills Acquired 


"Nonnal" 


R.I. 


Mass . 


Conn. 


Northern 


High 


5 


1 


8 


4 


7 


Many 


26 


19 


22 


31 


30 


Some 


47 


50 


,49 


49 


43 


Few 


17 


21 


20 


15 


15 


None 


5 


10 


5 


2 


7 
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These comparisons illustrate one way to compare institutes, but it is 
by no means the only way such comparisons can be made.' We observe that, in 
general, about twice as many Rhode Islanders claimed that no new skills were 
learned as compared with the norm. The participants at the Massachusetts and 
Northern States Institutes appear to have acquired a higher quantity of skills 
than the others. The "some" category, as expected, contains, the lion's"share 
of the respondents' answers-which is still a positive assessment about the 
value of the institute. 

F. The Development of Leadership.' and . Network Maintenance 
1. The Leadership Training Component 
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The leadership training components (see behavioral objective III . Appendix A) 
of the OLN program were not isolated events in the training program. Intern 
Assistants, State Coordinators, and participants were exposed to elements of 
leadership training at varying levels and varying degrees appropriate to the 
identified needs, of each of these groups'. For these reasons it is impractical 
to attempt to isolate specific elements of leadership training for purposes of 
evaluation. The activities in which leadership was a part, as described in 
the Plan of Operation, include the following: 

^' First Training Program, for Intern Assistants and State Coordinators* 
to prepare them for their respective .responsibilities as outlined- in the Plan 
of Operation; 

2. Practicum for Intern Assistants to. develop skills in program design, 
group process, and organizational behavior; 

3. -Workshop Training for all participants, to provide exposure to lead- 
ership skills which could be further developed during the OLN events in which 
they participated; 

4- Second Training Prog -am. for twenty-five selected participants, six 
Intern Assistants, and one participant from the Springfield Institute to pro- 
vide them withan opportunity to acquire additional skills in program design, 
group process, and organizational behavior. 

THE APPLICATION OF LEADERSHIP SKILLS ACQUIRED AS A DIR^ECT RESULT OF PAR- 
TICIPATION IN THE OLN PROGRAMS CANNOT. AT THIS TIME. BE ASSESSED WITH 
ACCURACY OR RELIABILITY BECAUSE OF THE SHORT TIME AVAILABLE TO SHOW EVIDENCE 
OF APPLICATION OF JHE SKILLS- DEVELOPED IN THE TRAINING PERIOD. A longitudinal 
evaluation would be required to measure the application of these skills. ' 
Evidences of leadership tendencies studied were: 

a. participation in follow-up activities; 

b. patterns of participation of Intern Assistants in program activities; 
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c. patterns of implementation of action plans; 

d. self-evaluation of outreach leadership skills. 

Patterns of participation in follow-up activities varied from state to 
state depending on the nature of the activity (see also Exhibit 15). Examples 
of these patterns are as follows: 

a. Action Plan Summaries — the average return was 58%. The low yields 
were Connecticut (32%) and Vermont (30%). 

b. Attendance at Follow-Up Meetings — the average^ attendance was ap- 
proximately 50%.' Massachusetts held three meetings but was the only state 
to fall below the average attendance figure (38%). 

c. Attendance at the Second Training Program — 24% of the institute 
participants were selected for this program. Of those selected, 41% were 
from Massachusetts, contrasted with 8% from New Hampshire. 

d. OI.N FolloW"Up Meeting (9/23-24) — Massachusetts had four repre- 
sentatives; Rhode Island, Connecticut, Maine, and New Hampshire had one repre- 
sentative each; and Vermont was not represented by an institute participant. 

e. Clearinghouse Task Force Meeting (10/4) —-Connecticut and New Hamp- 
shire were the only states represented by institute participants at this 'meeting. 

f. Steering Committee Meeting (10/5) — Maine^had the largest number of 
representatives. 

g. CEC/NEON Meeting (10/30) — There were three representatives from 

Massachusetts and two representatives from Maine. There vyere no participants 

ft. 

present from New Hampshire or Vermont. ' - ... 

Patterns of participation of Intern Assistants in program activities (sea 
also Exhibit 16) -- The average number of "required" events for any particular 
Intern Assistant was ten: the events included Training Program I, pre-workshop 
staff meetings, workshops, post-workshop follow-up rneetings, and the New 
England OLN staff meeting in July. Eleven of the thirteen Intern Assistants 
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completing the program attended at least ten events. Six of these eleven 
attended ten to thirteen events, and five attended between sixteen and 

, twenty-two events. 

Patterns of implementation of action plans — The following information 

, was derived from question 6, Part A of the Post Institute Survey Questionnaire: 

a. In Rhode Island r- 46% of the respondents completed action plans, 
and all were implemented; 

b. In Massachusetts — 33% of the respondents completed action plans, 
and all were implemented; 

c. In Connecticut — 50% of the respondents completed action plans, 
and 70% of these plans'^were implemented; 

d. In Maine — 29% of the respondents completed action pla:is, and 
50% of these plans were implemented; 

e. In New Hampshire — 40% of the respondents completed action plans, 
and all were implemented; 

f. In Vermont — none of the respondents completed an action plan. 
Self-e valuation of outreach leadership skills (see Exhibit 17 below) — 

Based on ^questions 2, 3, 5, 6, 7, 8, 10, and 11 in Part B of the PISQ, 80% of 
the participants from Connecticut and Northern States reported that they gained 
"some" new leadership skills. 5.3% of the Northern States participants reported 
that they gained no new skills. 76% of the participants from Massachusetts re- 
ported that they gained "some" new skills. 70.4% ofHhe participants from Rhode 
Island reported gaining "some" new skills. In contrast, 7.6%^,of the Rhode Island 

- participants reported that they gained no new leadership skills. 

EXHIBIT 17 ^ \ 

PER CENT DISTRIBUTION OF "LEADERSHIP" RESPONSES TO THE PISQi PART B 
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Skills Acquired 


"Normal " 


R.I. 


Mass . 


J^onn. 


Northern States 


High 


4 


2 




4 




Many 


24 


17 


19 


28 


30 


- Some 


50 


52 


52 


51 


46 


Few 


18 


22 


20 


. 15 


15 


None 


5 


8 


3 


3 


5 
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The potential for leadership might have been present in a participant 
prior to the institute or accelerated as a result of the institute experience. 
It is reasonable to assume that the institute experiences helped the indi- 
vidual to identify and apply latent leadership skills with the support and 
recognition of other OLN participants or aware administrators; It is equally 
possible that new- skills were acquired to apply to outreach problems, 
2, Evidence of Outreach Leadership Network Maintenance 

The degree of development of a network, in the sense which OLN has used 
the term, is indicated in three ways; 1) the distribution of participants; 
2) the distribution of distances traveled from a participant's or a staff , 
member's home to an OLN activity in another state. or a central site; and, 3) 
an inventory of pre- and post-institute activities combined with the frequency 
of parti cipati on *'b^particularly commited individuals. Other network evidence 
can be provided by monitoring the activity of OLN groups which are devoted to 
OLN "self-renewal" actions whi chilli more than likely survive the formal 
grant period. A more precise measurement would be to monitor mail and tele- 
phone calls between OLN participants and staff to determine the degree of 
personal interdependence,- but this procedure is patently unacceptable\ 

The distribution of participants, without regard to their intercommunica- 
tion, was discussed and illustrated above in the secti.on on Participant Char- 
acteristics (see Exhibit 4, page 92). 

The Intern Assistants and State Coordinators are distributed as il1us-^ 
trated on two maps, one of which shows this activity with reference to the 
^Rhode Island, Massachusetts, and Connecticut Institutes (Exhibit 5, page 94)', 
the other of which displays the routes for the Northern States Institute 
(Exhibit 6, page 95). A conscientious effort was fiiade to be certain that each 
Intern Assistant acted as a staff member at at least one institute held outside 
of his state of residence. 
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The next map (Exhibit 7, page 96) illustrates the twenty-three resident 
towns from which'thirty-two people converged upon Durham, New Hampshire for ' 
the Second Training Program, August 27-31, 1972. Every state was represented, 
this being the only event at which participants from all six New England 
states joined together. Most of the participants were selected from the 
previous four institutes for; intensive leadership training. 

Two committees have been formed by the individuals who have demonstrated 
a high degree of personal conmitment toward continuing OLN after che conclu- 
sion of the grant period. The Clearinghouse Task Force is drawn from all 
states but Maine arid Rhode Island, and is composed of nine meirfcers. The net- 
work map (Exhibit 18) illustrates the .two-weo' conmuni cations paths among them, 
with no headquarters location. Since these people have accepted responsibility 
to continue outreach information dissemination, a central administrative 
function may be necessary. The OLN Stee ring Committee is a group of twelve 
individuals from eleven towns which, working with the Clearinghouse Task Force 
and" other participants, intends to maintain the development and strengthening 
of OLN in the future. This group joined with the Continuinn Education Committee 
Task Force of the New England Library Association (NELA) and successfully 
petitioned to become a section of NELA, known as the New England Outreach 
Network (NEON). The home locations of the Steering Conmittee and the commu- 
nications channels open to them are ill ustrated .in Exhibit 19. 

VIII. OBSERVATIONS AND RECOMMENDATIONS 
< 

A. Observations 

Ihe term "observations," as used by the Evaluation Team, refers to state- 
rrents about activities or events occurring during the OLN program which, in 
the judgement of the Team men.i.-s, should be considered particularly by 



EXHIBIT 19 



Home locations of the OLN 
— S-teering-Coiiunittee- 



N = 11 





planners of related or similar programs. 

1. The opportunity and encouragement of participants. Intern Assistants, 
and staff to participate openly and actively in the planning, design, imple- 
mentation, and evaluation contributed significantly to the* accomplishment 

of the goals and objectives of the program. 

2. Decisions about the. content and format of the four Institutes and 
two Training Programs were made by groups composed of staff, participants, 
and the Network Advisory Committee. This multi-person approach to decision- 
making tended to overcome autocratic imposition of those decisions and gained 
early corranitment to their success on the part of the deci si on -makers. 

3. Concrete information and illustration about th^e techni^ues^of needs 
assessment, goal setting, objective setting, and evaluation are critical 
elements of any process workshop. 

4. The requirement for participants to write an action plan was de- 
emphasized, as the project progressed and an increased enphasis was placed 
on process skills. 

5. Skills presented in the Institutes me^y not have been new to some 
participants, but merely served to reinforce skills which were alreacjy known. 

6. The Intern Assistants, and some participants, exhibited solid 
patterns of personal and professional development of outreach and leadership 
skills. 

7. Location of the OLN project in an existing regional institutional 
setting enabled resource people to be utilized who already were coirarritted to 
regional concepts and who utilized network relationships that had been 
developed among* institutions in the region. 

8. While the goals of the OLN Institutes were directed toward improving 
services to unreached groups, the skills and concepts imparted by the Training 
Programs were generic to-the overall improvement of basic library services . 



9. As a result of exposure to the OLN program, the materials, staff, 
skills, and the "outreach concept" were, in some cases, adopted by other 
library personnel and non-OLN agencies, both in New England and nationally. 

10. A "temporary system" such as OLN is not encumbered with" the restric- 
tions of an institutionalized system and can introduce innovations without 
dealing with the established procedures of an existing system. The fact 
that, toward the end of the formal OLN program period, efforts to, preserve 
'the "temporary system" (OLN) within established regional agencies and organi- 
zations have been reasonably successful, suggest that the OLN program was, 
in the long run, non-threatening to those agencies and organizations. 

B. Recommendations 

"Recommendations" are the result of product evaluation activities which 
occurred during the program, and which are offered by the Team as information 
upon which recycling decisions can be made by planners and supporters of 
related or similar programs. 

1. Although adherence to a program goal should be maintained as invio- 
late during the implementation of OLN-type programs, associated objectives 
should permit sufficient flexibility of design to accommodate the particular > 
needs of participants after they are selected. This quality operated during 
the OLN program and should be preserved as- a method of operation. 

2.. Criteria for organizing groups in a region should not be restricted 
by state lines or other artificial geo-political boundaries. Such criteria 
should be related to needs and problems common to the region. 

3. The pre-institute screening process should include personal inter- 
views with candidates so that the expectations of those selected are congruent 
with the institute objectives. (The use of previous participants in this 
process would provide both continuity & credibility.) 

4. The Community Survey Questionnaire should be redrafted for use in a 



personal interview as part of the prescreening of potential participants. 

. 5. Decision-makers and those responsible for service policies in insti- 
tutions supplying workshop participants should be screened to determine if 
they are committed to the otrjectives of the project. 

6. Because the documentation process was extremely useful as a technique 
of evaluation, education, communication, planning, and record-keeping, the use 
of the form should be considered in process training programs when the number 
of activities cannot be predicted at the time of formulation of the Plan of 
Operation. 

7. Professional observation of the participants during a particular 
segment of a workshop is a faculty responsibility which should provide timely 
feedback to other faculty members responsible for that segment of the learning 
experience. It would be advantageous , therefore, if the workshop design 
provides for simultaneous observation and presentation: the division of 
faculty responsibilities being clearly assigned. 

8. When techniques of process behavior are model edJ^y^ faculty members 
in a presentation, the participants should be made aware of the potential 
applicability of the process model to meet their own needs. 

^. , Problem-sol ving techniques tend to be group-oriented. Therefore, 
workshop planners should provide alternative learning opportunities for 
individuals who learn more effectively in non-group settings. . 

10. Care should be taken by workshop faculty to relate unfamiliar con- 
cepts and terminology to the context of the personal and professional lives 
of the participants. 

11. More emphasis should be pl^aced upon overcoming problems of timing, 
funding, and staff involvement; factors which on the surface appear to be 
outside of the participants* control and tend to block the implementation pf 
action plans. 
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12. Agencies desiring to extend the skills of the participants in the 
OLN institutes and to enhance the impact of outreach activities would be well- 
advised to consider conducting propo^l -writing seminars as a logical next step. 

13. It is recommended that future evaluation teams be composed of two 

^ or more individuals whose corrbined skills contribute to the implementation of 
the skills of context, input, process, and product evaluation as defined in 
the CIPP evaluation model. 

14. The efficiency of an evaluation team would be enhanced by the 

< 

inclusion of a full-time data analyst who could attend all events as a 
^trained observer, communicate with the evaluation team, develop files of reports 
generated by the events, perform clerical tasks, and participate fully" in 
evaluation design activities. 

15. The evaluation team should carefully budget its time to insure that 
appropriate attention be given to all four phases of the CIPP evaluation model. 

16. A longitudinaj impact study should be conducted approximately two 
years after the completion of the project to measure outcomes that cannot be 
evaluated while the project is being conducted. Tho longitudinal evaluation 
should focus on the -application of OLN skills rather than become involved in 
an attempt to determine how they were acquired. 

17. A longitudinal study should evaluate the impact of the New England 
Outreach Network (NEON) as a regional vehicle for outreach and staff develop- 
ment because NEON i£ an indicator of the regional effect of OLN. 

18. Unless an OLN-type program is clearly identified as a temporary 
system at the beginning, there can be a high probability that it is perceived 
as an external threat to established institutions. Therefore, the contribution 
of such a temporary system may be diminished to the extent that it "threatens." 
This threat situation' should be reduced by i.ncluding these institutions in 

the planning and decision-making activities of the program. 
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In conclusion, care should be taken by funding agencies and program 
designers who wish to replicate the complex OLN experience in other regions 
of the United Stages, Regional characteristics differ (geography, community 
needs, status of librarians, etc,), and the personal qualities, skills, and 
dedication of the OLN Project Faculty are unique and difficult to replicate. 
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APPENDIX A 



GOAL AND OBJECTIVES OF THE PROJECT 

"This project addresses itself to the goal of providing for more 
effective public library services directed toward presently unserved 
community groups," (p, 8 of the Final Plan of Operation, August 31, 1971). 

"To achieve the goal as defined, two objectives must be met: 

!• to develop the ability of public librarians to formulate and 
implement action programs of library outreach through institutes 
designed to develop and test commitment and to build skills of 
outreach action planning, 

2. to develop leadership and organizational skills of individuals 
who will evolve a network to continue the outreach impetus of the 
project through training programs and opportunities to' deepen their 
skills"' (p. 10 of the Final Plan of Operation, August 31, 1971) • 

BEHAVIORALLY STATED OBJECTIVES FOR THE OUTREACH LEADERSHIP NETWORK 
PROJECT, 1971 - 1972, NEW ENGLAND CENTER. DURHAM, NEW HAMPSHIRE, 

OBJECTIVE I ^Participants will be able to* formulate a community-based 
action program designed to extend library services to specific target 
groups in their community which they determine to be inadequately served. 

To achieve this objective, the following skills must be developed: 
— ability to define "community", "in-adeiquately served" and 

"target group" as identified by written statements on 

a pre-institute survey instrument, 

— ability to involve the community in gathering relevant data 

about the needs in the community as shown by discovering 

and involving key community members in the data-gathering and 
data-sharing functions of the pre-institute community survey, 

— ability to identify community issues and describe potential 
target groups in the community as a result of the community 

survey as revealed in. the written community survey and 

in the action plan as developed, 

— ability to select a target group as a result of the community 
survey — by indicating which of the inadequately served groups 
is the target group which will be the focus of the action plan, 

— ability to work through a prescribed problem-solving process 
at the institute to develop an outline of an action program 

directed toward a specific target group as revealed by . 

the action plan formulated at the institute, 

— ability to revise and modify the proposed action program after 
the Institute by means of involving members of the selected target 

group in the decision-making process concerning the program 

as revealed by the follow-up instrument. 
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OBJECTIVE rr Participants ' will be able to implement a community- 
based action program designed to extend library services to specific 
target groups in the community. 

To achieve this objective, the following skills must be developed: 
— ability to relate present and potential library services to 

respond to community issues as evidenced in the written 

action plan, 

— ability to discover and use relevant resources in implementing 
the action plan as reported in follow-up status reports. 

— commitment to library outreach concepts as shown by 

sustained efforts to implement action programs • 

— ability to work with groups (e.g. community, staff, board, etc,) 
in order to facilitate their communic/^tions and decision-making 

in re the action program as revealed through documentation 

of institute performance and through evaluation instrumentation 
an'd follow-up status reports. 

, — ability to seek alternative ways of implementing the action 

plan in response to new data that becomes available before and 

during the implementation stage as shown at the institute by 

documentation and instruments and the action plan and after the 
institute through the follcw-^up status repoi'ts. 



OBJECTIVE rn Members of the training and ;:^clmin^ strative staffs will " 
demonstrate their leadership and organizational skills irtv carrying 
out their responsibilities with Institute participants and other 

staff, members before, during and after the institute in which 

they serve and in the training program(s) • 

To*- achieve this objective, the following skills must be developed: 
— ability to- give and receive help, on a one-to-one basis and 

within a group setting in the training program by means of 

observed and documented behavior, in the institute by means of 
the final evaluation form and in pre- institute and post-institute 
activities by means of follow-up status reports and other 
* field reports, 

» ** 

— ability to apply the problem-solving process to a wide range of 

problems, individually and within a group setting by means 

of documented staff analysis during the training program and 

institute and by participants* evaluation in follow-up instrumentation, 

— ability to take J.nitiative in program planning decisions as 

reveal6.d by documentary reports and via final evaluation form, 

— ability to plan for and implement effective interpersonal, inter- 
group and organizational communication strategies as revealed 

by documentation of meetings, final evaluation forms and follow-up 
instrumentation, 

— ability to utilize the critique/debrief /clinic process as a 
learning and evaluative device as revealed by documentation, 

ability to work effectively as a staff team in responding to 

issues and situations as shown by staff analysis, institute 

final evaluation forms and follow-up status reports* 




appendix b 

oVn field staff training program 

OCTOBER 18-19, 1971 

OBJECTIVES AND MEANS 

To prepare intern assistants for assuming their responsibilities 

to an institute (befoni, during and after) by: 

Means : determining the nature of that role through negotiation 
open planning meetings on Sunday and Monday 
role definition end clarification exercises 
sharing expectat^jons 

To .prepare state coordinators for their responsibilities before, 

during and after an institute by: 

Means : role definition and clarification exercises 
team building exercises 
needs and resources assessments 
evaluation process 

To provide an initial assessment of participant needs and resources 

in order to determine subsequent specific skills concentration in 

the various opportunities offered through the project;* 

Means : communications exercises 
group skills e){erci.ses 
team building 

helping relationship exercises 
resources and needs assessment 
evaluation process 
program planning 

To select four staff teams, each of which will share responsibility 
for all^ phases of an institute by: 

Means : method and criteria to be determined by group in exercise 
on group decision making using* problem-sol ving process 

To begin to develop inter- and intra-team relationships which will 

serve as a base from which to work on fulfilling responsibilities 

before, during and, after institute: 

Means : team building exercises 
team selection process 
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To involve parti cipan* 'n tKe evaluation process (data-gathering, 

documentation and interpretation) for the training program in 

order to prepare them for similar evaluative functions they will 

be performing before, during and after the institute: 

Means : feedback teams for each day 
documentation requirements 

To begin to explore possible roles for intern assistants and 

state coordinators and project staff in developing a network: 

Means ': dream exchange fantasy 



• -OLN LEADERSHIP TRAINING PROGRAM 

AUGUST 27-31 , 1972 

GOAL : The development of leadership skills in the context 

of group and intergroup dynamics. 



OBJECTIVES: 



1. To establish a clim^ate for self-directed learning 

si 

2. To assess the specific needs., interests , and 
resources of participants 

3. To identify one's present style of leadership 
and its impact on others 

4. To identify, explore, and practice the skills of 
leadership in various group and intergroup 
situations (e.g., decision-making, problem- 
solving, communication and intergroup dynamics) 

5. To apply and use these leadership skills .toward 
group task accomplishment 

6. To evaluate our learnings and their application 
to back-home settings 
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GOALS AND OBJECTIVES OF OLN OUTREACH INSTITUTE PROGRAMS 

1971 - 1972 



RHODE ISLAND OUTREACH INSTITUTE 

Purpose: To plan and implement action programs of extending 
public library services to unserved people in 
Rhode Jsland communities. 

To increase the librarian's ability to; 
--assess needs and resources in the community; 

in the library 
—work effectively with groups 
--develop effective means of communications with 

individuals and groups 
--use the program planning process to develop 

action programs of outreach 
--develop ways and means'for implementing action 
programs 

--evaluate action programs in terms of results 
and effectiveness » 



Objectives : 




MASSACHUSEHS OUTREACH INSTITUTE 

Objectives: To increase the librarian*!; ability to assess the 
attitude of one's self and one's institution 
•toward outreach 

To become aware of coimunity neods and resources 

{/ 

To increase skills of planning tif outreach action 
programs 

To increase skills for implementing an outreach 
action program 

To increase skills for evaluating outreach action 
programs ^ 

to increase the ability to. build support for programs 
(staff, board J community groups, etc.)^ 
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CONNECTICUT OUTREACH INSTITUTE 

Goal: To increase personal effectiveness of each participant 

in working with people and programs in order to be 
effective in reaching unserved groups and individuals 



Objectives: To learn techniques for developing support systems 

with colleagues, staff, and' community to facilitate 
initiating and maintaining outreach programs 

To improve the ability to communicate by listening, 
questiqnning, clarifying, etc* 

.To build skills for outreach action programming, 
M'ncluding planning, implementing, and evaluating 

To improve the" ability 'to work in and with the 
conimunity;%_£reat[ng awareness of its needs, 
resources, and responses, by improving the 
library>.s^app reachability and by eliciting 
community "feedback" 



NORTHERN STATES OUTREACH INSTITUTE 

Goal: - « To enable librarians to make their librariiss a^more 
dynamic and action-oriented part of the community 
by increasing their effectiveness in serving 
unreached groups in the community with library 
services- 

^Cr* Objectives: To deepen the librarians awareness of community; its 

'nature, and dynamics ^i/ 

To increase the ability of librarians to cfommunicate 
and cooperate with their communities and with other 
'librarians 

To build skills of planning effective outreach 
" , ' , programs ' 

To build skills to implement, (put into practice) 
^ action programs 
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APPENDIX D 



Outreach Leadership IJetwork 

ROSTER 



project staff 

Pr oject^ Director : 
Project Consultant : 
Pro:|ect Coo rdinator; 



Barbara Conroy 
Lawrence Allen 
Margaret Soper 



Project AssistantTSecretary : 

Cynthia Giesing (thru ^August 1972) 
Irene Fleming (since August 1972) 

Staff vitae appear in Appendix E 

, INTERN ASSISTANTS 

*William Alexander IV, Director 
Westerly Public Library 
Westerly, Rhode Island. 

*Eleanor Arthur, Director 
Bedford Free Public Library 
Bedford, Massachusetts. 

Mary Bennett, Librarian 
Oxford ,\ Maine. 

Grace Birch, Librarian 
Trur*ull, Connecticut 



Evaluation Team : 
John Bardwell 
Peter Home 
Ronald Miller 

Data Analyst : 
Lynne Brandon 



Kathleen Geary>, Librarian 
Fletcher Free Library 
Burlington, Vermont 

Helen Harding, Librarian 
Gale Free Library 
Hoi den, Massachusetts 

*01iver Hayes, Director 
Forbes Library 
Northampton, Massachusetts 



*Marcia Lowell, Executive Secretary 
Maine Library Advisory Committee 
Augusta, Maine . 

Sheila McKenna, Consultant 
Maine State Library 
Augusta, Maine 

■Donald Mullen, Director 
Dover Public Library, N.H. 

Corinne Nash, Librarian 
Frost Free Library 
Marlborough, N.H. 



* Roger Parent, Director 
Sixteen Acres Library 
Springfield, Massachusetts 

*Barbara Weaver, Director 

Willimantic Library Service Center 
. Willimantic, Connecticut 



STATE COORDINATORS 
Joseph Boisse 

Director of Extension Services 
Department of libraries - 
Montp.elier, Vermont 

Alice Cahill, Assistant Director 
Mass. Bureau of Library Extension 
Boston, Massachusetts 

Avis Duckworth 
Assistant State Librarian 
State Library 
Concord, N.H. 



Gary Nichols 

Library Development Services 
Maine State Library 
Augusta, Maine 

Mary Anna Tien, Director 
Library Service Center 
Middletown, Connecticut 

Richard Waters 

Div. of Library Extension Services 
Department of State Library Services 
Providence, Rhode Island' 



NETWORK ADVISORY COMMIHEE 



Representing State Library Agencies : 

Mr. Emil W. Allen, State Librarian, Concord, New Hampshire 
Mr. Walter Brahm, State Librarian, Hartford, Connecticut 
Miss Alice Cahill, Assistant Director, Massachusetts Bureau of 

Library Extension, Boston', Massachusetts 
Miss Jewel Drickamer, Deputy Director, Department of State Library 

Services, Providence, Rhode Island 
Miss Ruth Hazelton, State Librarian, Augusta, Maine 
Mr* James Igbe, Jr., State Librarian, Montpelier, Vermont 

(replaced by Mr. Joseph Boisse in fall, 1972) 
Mr. Joseph Boisse, Assistant State Librarian, Montpelier, Vermont 

Representing State Coordinators : 

Mrs. Avis Duckworth, Assistant State Librarian, Concord, N.H. 
Mr. Gary Nichols, Extension Librarian, Maine State Library, 

Augus^'ta, Maine' 

RepresentijTg Intern Assistants: 



Miss Kathleen Geary, 
Mrs. Bartara Weaver, 



Librarian^ Fletcher Free Library, Burlington, Vt. 
Assistant Director, Willimantic Library Service 
Center, Connecticut 



Evaluation Team: 



Mr, John Bardwoll , 

Mr. Peter Home, 
Mr. Ronald Miller, 



Chairman, Media Services, University of New 
Hampshire, Durham, New Hampshire 
Educational Consultant, Rye, New Hampshire 
Director, New England Library Information Network, 
Wellesley, Massachusetts 



U.S. Office of Education (Project Monitor) : 



Miss Arlene Hope, 



Library Services Program Officer, Government 
Center, Boston, Massachusetts 



New England Center for Continuing Education; 



Dr. Harry Day, 
OLN Staff: 



Director, New England Center, Durham, N.H. 



Dr. Lawrence Allen, 
Miss Barbara Conroy, 
M'^s. Margaret Soper, 



Project Consultant 
Project Director 
Project Coordinator 
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OUTREACH INSTITUTE PARTICIPANTS 



Connecticut 



Marjorie Anderson, East Hampton 
Millicent Beausoleil, Putnam 
Helen Becker, Hartford 
Ritamarie Braswell, Mansfield 
Ronnie Brill , Unionville 
Sandra Broom, Madison 
Joan Butler, Nev/ London 
Wendell Cherry, Stamford 
Alberta Christie, Naugatuck 
*Robert Coumbe, Hartford 
June Csoltko, Bridgeport 
Mary Flood, Portland 
Barbara Hubbard, New -Britain 
Bruce Kershner, Fairfield 



Shirley Kiefer, Hartford 
*Elizabeth Long, Bridgeport 
*Mary Beth Mahler, Hartford 
Center Barbara Martir., GreenHch 

W. Clayton Massey, South Windsor 
Eileen O'Neill , New Haven 
*Concetta Sacco,. West Haven 
AHce B. Slater, Clinton 
Martha Strickland, Wolcott 
.Edward Stubbs , Simsbury. - 
Mary Teed, Norvnch 
*Joan Turner, Stamford 
Dennis Weir, Glastonbury 
Leslie Weirman, Danbury 



Maine 

Agnes Abfahamson, Falmouth 
Katherine Conant, Rumford 
Myrle Cooper, South Windham 
Carolyn Cornett, Augusta 
Pamela Georgitis, Sanford 
Nathanael Greene, Portland 
*Richard Gross, Lewiston 



*Sheila Libby, Portland 
Alice Morey, Fort Kent 
'Sarbara Shelton, Wiscasset 
*Barbara Smith, Portland 
Barbara Trott, Castine 
Mary-Faith Walker, Belfast 
Laura Whitten, Gorham 



Massachusetts 

*Kathleen D. Bader,. Orleans 
Virginia B. Bernard, Haverhill 
Elise C. Dennis, Amherst 
*Joyce F. Ellis, Worcester 
*Kathy M. Finucane, Bedford 
Vera Fish, Westwood 
Marthe Forrester, Watertown 
Norma Haynes, Hudson 
*Sylvia G. Humphrey, Springfield 
' Alice V. Johnson, Salem" 
*James R. Kennedy, Bourne 
Dina G. Malgeri, Boston 
Gaynell T. Mathson, Charles town 



Margaret J. Mayo, Topsfield 
Marguerite H. Messer, Springfield 

.*Charles F. Moore, Auburn 
Priscilla B.- Nelson, North Adams 

*Leila-Jane Roberts, Winchester 
Alicia Rounsaville, Boston 
Harry Sagris , Andover 
Susan V. Scheidel, Saxbnville 

*David T. Sheehan, Worcester 
Laurence H. Solomon, New Bedford 
Raymond E. Tellier, Holyoke 

*ElTzabeth S.Watson, Fitchburg 

*Harry R. Williams 111, Worcester 
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New Hampshire 

Anne Abbey, Mil ford 
Ingeborg Anderson, Francestown 
Mabel Davies, Sunapee 
Winifred Ann Harding, Newmarket 
Eleanor Hunt, Newport 
" *Sheldon Kaye, Concord 



Ruth Palm, Keene 
Louise Price, Manchester 
Rachel Sanborn, Exeter 
Kathleen Taylor, Peterborough 
Frances Wiggin, Bedford 
Dorothy Worcester, Dublin 



Rhode Island 



Hanna Agonis, Westerly 
*Will.iam Alexander, Westerly- 
Constance H. Andrews, Providence 
Dorothy Brown, Providence 
Martha Bui lard, Cumberland 
*Roberta A.E. Cairns, Barrington 
Paul Crane, West Warwick 
Charles Ci^sby, Providence 
*Carol Cunniff, Barrington 
Elizabeth E.^Davies, East Providence 
Deirdre Donahue, Providence 
Virginia'Conner, East Providence 



Helen M. Doolan, Providence 

Joseph T. Fitzpatrick, Coventry 

Alice Forsstrom, Warwick 

Carolyn Hearn., Westerly 

Sarah Henderson , Foster 
*E. B.Henry, Jr., Newport 

Virginia T. Miles, Providence 

Leo Pinson, Providence 

R.W. RoBbins, Pawtucket 
.Carolyn Sirmions, Providence 

Ellen P. Spilka, Pawtucket 



Vermont 



William -Ay res , St. Johnsbury 
Carol Church, Putney 
Isabel Cloud, Norwich 
Maxine Cooper, Bridgewater 
Ange-Aimee Martin, Middlebury 



David Monty, Manchester 
Jane Rand, Brattleboro 

*Janice Rushworth, HontpelieV 
Hobart tracy, Waterbury 

*Daniel Westermeyer, Rutland 



Leadership Training Program participant. 

Mary Steigner, Springfield, Mass. was a Leadership Training Program 
participant although she was not a participant in the OLN Massachusetts 
Outreach Institute. 

\ 0 
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PROFESSIONAL TRAINING STAFF 



In addition to the full-time professional faculty, Lawrence Allen 
and Barbara Conroy, resource teams brought additional professional 
training skills to the Outreach Insti tute^-^workshops. In coordination 
with the institute staff teams, these indrviduals planned and conducted 
workshop sessions wi th /eliiphaseG ,on: the interi)ersonal skills essential 
to the implementation of the action plans which each participant was 
developing, at the workshops. Joe Arceri an.d Diana Forsyth were full-time 
faculty, solely responsible for planning and coordinating the Leadership 
\_ Training Program in August 1972. 




Joseph Arceri: 

Paul Fahey: 

Diana Forsyth: 
« ^ 

Judy Palmer: 
Winthrop Puffer: 
, Ken Robinson: 
Karen Teminko: 



J.P.D- Associates, 516 Commonwealth Ave., 
Newton Center, Massachusetts 

J.P.D. Associates, 516 Commonwealth Ave., 
Newton Center, Massachusetts 

J.P.D. Associates, 516 Commonwealth Ave., 
Newton Center, Massachusetts 

Co-Director, Life Studies Program, 
University of New Hampshire, <Durham 

Project Manager, Head Start Supplementary 
Training, Department of Honfe^onomics, UNH. 

Coordinator, Allied Health Programs, South 
Central Cormiunity College, New Haven, .Conn. 

Advisor, Head Start Supplementary Training, 
Department of Home Economics UNH. 



ERIC 



155 - 



APPENDIX E 

• V I T A E 
PROJECT STAFF 

Project Director 
Barbara Conroy 

Twelve years experience as librarian in public and academic libraries. 
Has been responsible for professional continuing education programs on 
local, regional and national levels. Consults with libraries, library 
associations and state agencies in regard to staff development programs 
and organizational development. Directed Washington Seminar; the Library 
Career Development Program^at Catholic University (1970-1971) and 
coordinated the Educational Development Program for Library Personnel, 
WICHE (1968-1969). M.L.S. from Denver University; doctoral candidate 
(adult education) at Boston Univ ersity .^ 

OLN: Responsible for total project management and coordination of 
program activities and staff. Served as full-time faculty for all 
workshops and training programs. Provided support of efforts initiated 
by individuals interested in continuing the thrust of the project. 

Project Consultant 

Lawrence A. Allen, Dean, College of Library Science, University of 
Kentucky, Lexington, Kentucky. 

Responsible for outreach public library work in Brooklyn Public- Library; 
experience in all types of libraries. Evaluated New York State Library 
training program. Has over 15 years of library, teaching and consulting 
work in library science education and management. Has developed over 
100 workshops and institutes utilizing adult education methodology. 
Consultant for Educational Development Program for Library Personnel, 
WICHE. Consults with state agencies, professional associations, libraries, 
educational institutions and health agencies in areas of management and 
organizational development. Ph.D. in Adult Education, University of 
Chicago and M.S. Library Science, Simmons College. 
OLN: Served total project as consultant in program development and 
staff development. Acted as reserve administrator for project when 
necessary. Was full-time -faculty for all institute programs and the 
Staff Training Program. 

Project Coordinator 

Margaret Soper, Assistant Director, Division of Continuing Education, 
University of New Hampshire, Durham, New Hampshire. 

Administers the b'NH Conference Department which is responsible for 
international, national, regional conferences, workshops and institutes. 
Serves as coordinator of Public Library Techniques program and. the 
annual Student Leadership Conference (NESLA) . Extensive experience 
in planning and coordinating conferences, strong practical background 
in administration of continuing education activities. 
OLN: Coordinated necessary administrative procedures for the project; 
handled the administrative aspects of the project's relationship to UNH; 
served as consultant to the state coordinators. 
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Project Assistant/Secretary 



Cynthia Giesing 

Provided a central contact point and referral source for the project. 
Coordinated communications with field staff. Editor of Network News 
Notes and assisted with the project brochure. Maintained office 
headquarters including management of project business and initiation 
and follow- through of correspondence. Arranged scheduling and provided 
documentation for staff meetings. Provided administrative coordination 
of Staff Training Program and Leadership Training Program. 

Irene Fleming 

Served as Project Secretary, August through December, 1972-. Responsible 
for office procedures, correspondence and financial accounting during 
the final project administrative activities. 

EVALUATION TEAM 

E valuators 

^^^^^ * > 

John Bardwell, Director of the. Department of Media Services and Associate 
Professor in the Library at the University of New Hampshire in Durham. 
Served -for 'two years as Chairman of the Needs Assessment Project for the 
New Hampshire State Department of Education", is. Institutional Representative 
to EDUCOM, and Chairman of the University. System Media Services Council. 
Served as consultant to the Governor's Conference on Social Issues, the 
Governor's Conference on Juvenile Delinquency, the Governor's Conference 
on Cable Television, The New England Center for Continuing Education and 
the Spaulding Youth Center. His publications include two monographs: 
A New England Land-G rant Network and Toward A New Hampshire Informa tion 
Network. 



Peter J. Home, consultant in adult education, is presently project 
consultant to the New England Regional Commission for the development of 
the New England Marine Resources Council. A former staff member of the 
New England Center for "Continuing Education at the University of New 
Hampshire, he has also served as a program .design consultant to the New 
England Hospital Assembly, University of Maine Cooperative Extension 
Service, U.Maine-NEC activity. Fall Rlveir Public School System, and the 
New Hampshire Governor's Conference on Juvenile Delinquency. Publications 
in elude : Operation Mainstream, A Report on Problem Solving and the 
Helping R elationship , co-authored with Garald J. Pine, Professor of 
Education;, University of -New Hampshire, the New England Center for 
Continuing Education, Durham, New Hampshire, 1968; and The Principles 
and Condi tions for Learning in Adult Education , co-authored with Gerald 
J. Pine, Professor of Education, University of New Hampshire, published 
in Adult Leadership. Adult Education Association of the United States of 
America, Washington, D.C., October, 1969. 
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Evaluators (continued) 



Ronald F, Miller > Director, New England Library Information Network, 
Wellesley, Massachusetts. Taught courses on library automation, 
information systems, and systems analysis at Syracuse University's 
Graduate Schoql of Library Science, and has lectured widely on inter- 
library cooperation and decision-making. He is a member of the New 
England Library Regional Planning Committee (NELA) , President of the 
New England Chapter of the American Society of Information Science, 
and chairman of long-range institute planning for the Information 
Systems and Automation Division of the American Library Association. 
He holds an M.L.S. (Rutgers) and has investigated the process of 
decision-making in libraries 'as part of his Ph.D. program at Syracuse. 
Publications include: "The Computer Utility: Implications for University 
Libraries," Chapter 12 in The Computer Utility— Implications for Hipher 
Education , edited by Michael Duggan, et . al . , D.C. Heath and Company, 
Lexington, Massachusetts, 1970; Network Organization: A Case Study of 
the Five Associated University Libraries (PAUL) , paper presented at the 
Conference on Inter-library Communications and Information Networks , 
held at Airlie House, Warrenton, Virginia, September 28-October '2, 1970, 
published by the American Library Association. 

Data Analyst 

Lynne Brandon 

From September to December, 1972, perfoi^med data reduction functions 
for the members of the Evaluation Team. Documented and coordinated Team 
activities, including liasion between Team and Project Sir.aff. Documented 
staff meetings. Responsible for graphic designs, 3ayou':, and preparation 
of Team's final report. In addition, from February to June, 1972, 
responsibilities relating^to total project included assisting the 
headquarters staff with correspondence and planning details. Helped 
produce and distribute the project brochure. Supplemented administrative 
staffing for some workshops. Designed project logos* 
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APPENDIX F 



CHRONOLOGY OF OLN EVENTS 



1971 Sept 20 Network Advisory Committee meeting 

Sept 21 Program Development meeting (staff and faculty) 

Oct 6-8 Briefing Session at NELA for Field Staff 

Oct 8 Evaluation Team meeting 

Oct 17-19 Field Staff Training Program 

Oct 20 Program -Development meeting (staff and faculty) 

Nov 29 Northern States Institute StaTf meeting (planning) 

Nov 30 Rhode Island Institute Planning meeting 

Dec 9 Rhode*^ Island Institute staff meeting (objectives setting) 

Dec. 10 Massachusetts Institute Planning meeting 

Dec 21 Evaluation Team meeting 

1972 Jan 3 Prcqram Development meeting 

Jan 4 Rhode Island Institute staff meeting (program design) 

Jan 5 Massachusetts Institute staff meeting (objectives setting) 

Jan 29-30 Rhode Island Institute staff meeting (final ^planning) 
Jan 30-Feb 3 Rhode Island Outreach Workshop 

Feb 3 Rhode Island Institute staff meeting (de-briefing) 

.Feb 14 Program Development meeting 

Feb 15 Network Advisory Committee meeting 

Feb 16 Connecticut Institute staff meeting(planning session) 

Feb 17 Program Development meeting 

Feb 18 Massachusetts Institute staff meeting (program design) 

Mar 4 Communications Team 

Mar 9 Northern States Institute staff meeting (planning) 

Mar 10- Northern States Institute Planning meeting 

Mar 11 Program Development staff meeting ' 

Mar 13 Massachusetts Ins^titute staff meeting "(final plannijng) 

Mar 13-17 Massachusetts Outreach Workshop 

Mar 17 • Massachusetts Institute staff nieeting (debrief) 

Apr 3 Program Development meeting 

Apr 4 Connecticut Institute planning meeting 

Apr 5 Connecticut Institute staff meeting (objectives) 

Apr 6 Communications team (action planning) 

Apr 14 New Hampshire/Maine meeting for participant selection 

Apr 17 Northei'Ti States Institute staff meeting (objectives) 

Apr 18 Connecticut Institute staff meeting (program design) - 

Apr 19 Rhode Island Follow-up meeting 

Apr 20 Communications Team (action planning) 

Apr 26 Massachusetts Follow-up meeting 

May 1 Northern States Institute staff meeting (program design) 

May 11 OLN program at New Hampshire Library Council conference 

May 13 Communicatiorts Team (action planning) 

May 20-21 Connecticut Institute staff team (final planning) 

May 21-25 " Connecticut Outreach Workshop 

May 25 Connecticut Institute staff team (debrief) 

May 26 . Program Development meeting 
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1972 June 2 Massachusetts Follow-up meeting 

June 10-11 Northern States Institute staff team (final planning) 

June 11-16 Northern States Outreach 'Workshop 

June 16 Northern States Institute staff team (debrief) 

June 17 Program' Development meeting 

June 27 OLN Open House at ALA conference 

July 6 ' New Hampshire planning meeting for follow-up 

July 8 Communications Team (action planning) 

July 12 Massachusetts Follow-up meeting 

Jul^ 12 Connecticut Follow-up meeting 

July 13 Evaluation Team meeting 

July 28-29 General staff meeting for all field .staff 

July 31 Program Development meeting (faculty and staff) 

Aug 1 Maine Follow-up meeting 

Aug 5 Planning meeting for Training Program (objectives setting 

Aug 9 Planning meeting for Training Program (program design) 

Aug 11 , Prograiri Development meeting 

Aug 18-19 General staff meeting for all field staff 

Aug 21 New Hampshire Follow-up meeting 

Aug 27-31 Leadership Training Program 
Sept 8-9 " Program Development meeting 

Sept 11 Maine Follow-up meeting 

Sept 15 Leadership Training Program debrief meeting 

Sept 18 Planning meeting for OLN Open House at NELA 

.Sept 20 Planning for Outreach Leadership Follow-up Workshop 

Sept 21 Evaluation Team meeting 

Sept 22-24 .Outreach Leadership "Follow-up Workshop 

Oct 1 Evaluation Team meeting 

Oct 4 Clearinghouse Task Force meeting 
Oct 5 , Steering Committee meeting 

Oct 5 OLN Outreach Program and Open House at NELA 

Oct 9 Evaluation Team meeting 

Oct 21-22 Evaluation Team meeting 

Oct 24 Network Advisory Committee meeting 

Oct 24 Clearinghouse Task Force meeting 

Oct 30 Steering Committee meeting with Continuing Educatior. Committee (NEl" 

Nov 7 Evaluation Team meeting 

Nov 19 Evaluation Team meeting 

Dec 3 Evaluation Team meeting 

Dec 4 " *ogram Development meeting 

Dec 6 sachusetts Follow-up meeting 

Dec 12 hvaluation Team meeting 
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WORKSHOP WAY OF LEARNING 

Outreach Leadership Network.' 

New England Center , 
Durham, New Hampshire 03824 

This workshop is planned to provide each participant with 
varied opportunities to increase his/her ability to plan and 
implement action programs of public library outreach. Along with 
these program planning skills will come the chance to exchange ' 
one\s own point of view with others seeking the saine^ goal (i.e., 
better library s^ervices through outreach) but perhaps considering 
a different approach. 

The program is a concentrated sequence of work sessions ^ 
involving both the staff and the participants in a step-by-step 
development of individual action programs. Some sessions will 
involve the total group together, other sessions will involve 
smaller working groups. Time for participants to work alone or 
with consultant help is also scheduled. Resources — staff, books, 
research and work materials — will be available for each 
participant to use in whatever way is most feasible for him/hcc. 

Certain basic principles arc involved in effective adult 
learning, and this program, one of continuing professional 
education, is based on the following precepts. They are stated 
here to assure a coriimon point of reference for those coming to 
the program. 

The processes of problem-solving and learning are highly 
unique and individual. Each person has his own unique 
styles of learning and of solving problems. People some- 
times need help to define and to 'i^iake explicit to themselves 
the approaches they ordinarily use so that thr^y can become 
more effective. 

Learning is the discovery of the personal meaning and 
relevance of ideas through experience. It is a process 
which requires the exploration of ideas in relation to self 
and community so that people can determine what their heeds 
are, what goals they would like to formulate, what issues 
they would like to discuss, and what they would like to 
learn. 

One of the richest resources for learning is the learner 
himself. Each individual has an accumulation of asperlenr.x^.s , 
ideas, feelings, and attitudes which comprise a rich vein of 
materi;=:i for problem-solving and learning. Situations which 
enable people to become open to themselves ^ to draw upon their 
personal collection of data, and "to share their dati ±\\ 
Cooperative interaction with others maximize learning. 
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n ^^^"^^"8 ^3 ^ cooperative and collaborative process. 
Problems which are identified through cooperative inter- 
.•^.tion appear to challenge and to stretch people to produce 
creative solutions and to become more creative individuals. 

Learning, is an experience which occurs inside the learner 
, and is activated by the learner. Learning is not only a 
fvmction of what a teacher does to or says to or provides 
for a le^amer. More significantly, learning has to do with 
something which happens in the unique -world of the learner 
Learning flourishes in a situation in which teaching is 
seen as a facilitating process that assists people to 
explore and discover the personal meaning of events for 
them. 

The process of learning is emotional as well as 
intellectual. Learning is affected by the total state of 
♦ the individual. 

Learning is> an evolutionary process and sometimes painful. 
It calls for giving up the old and comfortable ways of 
believing, thinking, and valuing. 

The climate that promotes learning is most able to occur 
when these precepts are understood and accepted by those 
involv.ed in the program - both staff and participants'. We state 
them here for they provide the base from which we work. The " 
residential nature of this workshop will serve to foster 
concentration within the "learning community" we all create apd 
to ise?''°""^^ °^ resources brought together for you 

- We will be working together for the existence of an open 
climate in which each individual's learning is " characterized 
by its uniquely personal and subjective nature. This goal can 
°" ^ .^/.""l^^^^^ ^ atmosphere of acceptance arid respect for 
each individual and of tolerance for ambiguity ,• difference 
and confrontation. D-iep and lasting learning is a cooperative 
process with built-in opportunities for self-assessment and 
reflection and the exchange of ideas with oWs. Above all 
the ability to learn, and to make good use of what is learned, 
rests on the involvement and investment of the individual 

u'^^- '^^^""^^ t° the individual are equal to the degree 
to which he invests himself in the process of his own' educr.cion. 



Larry Allen 
Barbara Conroy 



ERIC 
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APPENDIX H 



Outreach Leadership IJetwork 

New Engird Center 
Durham, New Hampshire 0382A 



DOCUMEt^TATIQN FORM^^-HEETINGS 



This report is ^led for all OLN meetings-— NeVwork Advisory Committee 
meetings, Planning Committee meetings, staff meetings, etc. As such, 
it represents the documentor's point of view, " 

TITLE: (What k?nd of meeting x^as it; e.g. 

Planning Committee meeting, b\ 
meeting, etc.) 
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DATE AIvID LENGTH OF MEE TING 
LOCATION : 



CONVENOR: 
boCUMEN TOR(S) 
ATTIiSDING I ' 



ABSENT ; 
PURPOSE(S) 
OF MEETING: 



MAIN ISSUES AND 
CONCERNS ; 



DECISIONS MADE: 



NEXT STEPS; 



(Who "called" the meeting?) 
(Wlio is writing this report?) 
(List ^"ho was there, as participant 
or observer. Attach list If one 
was printed for the nieeting.) 
(Who was invited hue did not come.) 
(Give reasons and intent as stated 
in the meeting, :ln preliminary 
material, or as generally understood 
by attendees. Attach letters or 
meeting notice if one was mailed out.) 
/(What did tiie meeting focus on? 
/How were iosues resol-fed? How did 
. attendees interact on the various, 
issues?) > 
(List the decisions made ?iy the 
group or those announced to the 
group. Indicate how these decisions 
were arrived at.) 

(Ivhat needs to be done? Who will be 
responsible for what? By when?) 



_v A.c&puusiLij.e tor wnac: uy wnenr; 
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MAJOR PROBLEMS' 
DURING MEETING: 



DOCUMENTOR'S 
EVALUATION OF 
MEETING: 



(What held up progress? What 
pre>;ented decisions from being made? 
What were "hot" topics?) 
(How did you perceive the meeting in 
terms of communication, participa.tlon, 
de cis ion-makin g , p rob lem-s o 1 vin g , 
and general group process observ- 
ations? 'Include comments on informal 
gatherings prior to and following 
the conyened meeting ♦) 
(Describe your perception of the things 

. you did oj: didn^t do during the meeting. 

How dici your participation affect the 
meeting?) 

This £orm is to be completed as soon as possible after the meeting, 
se-.c to the :)LN office where it will be reproduced and distributed' 
-o your staff team. The top portion of the report will not be sent 
to meecing attendees- without the knowledge and consent of the staff 
team. The entire report is available only to the staff team, the 
project office staff, and the evaluation team. 
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EVAIiUATION OF MY 
PARTICIPATION : 



Outreach Leadership iN^work 

New England Cente- . 
Durham, New- Hampshire 03824 



^ ^ WORKSHOP SESSION DOCUMENTATION FORM 
This report isi used to describe OLN workshop programs. 
Session : (day°, time, locale)^ 



Name of Documentor: 

Who attended if other than a general session : 



Purpose of session : (intents of this Session, e.g., a purpose of 
an opemjig session would -include to establish a climate which 
fosters open discussion; to provide basic information needed by 
participants and staff to work together, etc.)- • 



Methodology used. 1. (what is the desi.gniof the session., and which 
-staff menaeKS did what functions, e.gi, Larry convened the group 

and numbereo off for -small groups' of six, which ws-re charged to" 

addr^ess three questions. . .etc, ) ! 



Process Comments :' (how did you perceive the session in terms of 
communica+ion, participation., decision-rmaki^ig, etc.?) 



Documentor's Evaluation : (how well were the purposes accomp/Tished? 
« Was the material presented clear and understood, what un-^lled 
; ne.'3ds did you see?) Put on back of this sheet.. 



0 



APPENDIX I 

The following information is required by the federal government from all per- 
sons participating in federally-funded Institutes for Training in Librarian- 
ship under Title II-B, Higher Education Act of 1965 (P.L. 89-329 as amended). 

Outreach Leadership Network. 
New England Center, Durhanij N.H. 03824 

APPXICATION FOR ADMISSION 

IMPORTANT — Please return this to the Project Office* It must be received 
by in order for stipend checks to be prepared for you to use 

to pay your accommodations bill. 

NAME: Position: 



HOME ADDRESS: LIBRARY ADDRESS: 



PHONE :_ * PHONE: ^ 

Sex: F M Married? Unmarried? U.S. Citizen? 

Social Security Number: . 

DEPENDENTS : 

Number of dependents claimable for income tax puirposes (if you file 
a joint return and are not the major wage earner, you may not claim, 
any dependents) 

ONLY ONE DEPENDENT MAY BE CLAIMED FOR DEPENDENCY ALLOWANCE FOR INSTITUTE. 
I ' claim* as a dependent : 

Name 7 " Age ^ Relationship ^ 

Have you previously attended a Title IX NDEA or Title II-B*HEA Library 

Institute Program or some other federally supported training program?^ 
If yes J specify each: 

Are you applying to, any library institute in addition to this one?. 

If yes, specify institution and subject fields: 



I certif/ that the above information is . jmplete and accurate to the best of 
jpy knowledge. 



Date Signature 

Conducted under a grant from the U.S. Office of Education, Title II-B, 
Higher Education Act of 1965, P.L. 89-329, as amended. It is in 
compliance with Title VI of the Civil Rights Act of 1964 and does not 
discriminate on the basis of race, color, cr national origin. 



PEBSONAL DATA FORM 

The following information is required by the federal government from all 
LibrSJiSf '''f "f/? federally.funded Institutes for T^Sning'n 
Librarianship under Title II-B, Higher Education Act of 1965 (P?L 89-329 
as an^nded). This infbrmation is forwarded to the Office " Edicition^d 
•is otherwise held as confidential information in the project fiLs -> 



Name 

Address 



-Social Security Number 

Sex .Age 

Race 



Currer.t Salary 



APPENDIX J 



COMMUNITY QUESTIONNAIRE — RHODE ISLAND INSTITUTE 

This form should be completed and returned to the Outreach Leadership 
Network, New England Center, Durham,, New Hampshire, by MONDAY , JANUARY 24TH > 

Workshop Participant: 
Community : 

1, What are the major issues presently in your community (e.g., unemploy- 
ment in r.he skilled trades, low-income housing, etc,)? Which are short- 
term, which are long-term as you see "^the future? 

1* What groups in your conrniuniny do you feel are not adequately provided 
with needed informacion services? \^ 

3* Rank, in order of priority (1-2-3 etc,, with //I being highest) those 
groups in Question 2 for which you would most like to develop an, 
outreach program. • 

4. Give a brief description of each of your top priority groups from Question 
3. Include* what you feel are the chief important characteristics of each 
group. 1 

5- Do you have current programs of library outreach? Briefly describe which 
community ^groups they serve and in what way. Use attachments if you prefe 

6, Do you ilready have in mind a particular action program of outreach you 
wish to work on during the Outreach Leadership Network institute program? 
l^fhat is it? 

?• What do you feel are the chief factors which inhibit the development and 
implementation of additional needed outreach programs? 

OLN 1/72 



Workshop Participant: 'v 

Community: 

PRELIMINARY ACTIVITIES FOil PARTICIPANTS 

of the * 
CONNECTICUT OUTREACH INSTITOTE PROGRAM 

This form is to be returned to the OLN orfice by May 16th, Your comments in 
respo72'-?i to these questions will help the Institute staff understand and 
respond more quickly to participants* interests at the workshop. 

What is your definition of library " outreach? 

How does your staff and/or .board view library outreach? (We suggest t]?at 
you meer with your staff and/or board and encourage discussion of their 
concepts and definitions of library outreach.) 

What are their ideas as to what outreach activities your library might . 
consider and develop?"*^ 

What are major isoues^iu your community (e.g., unemployment In skilled trades, 
low-income housings etc.)? Whl \. are short-term, which are long-term as you 
see the ^^ture? ' ^ . ^ > 

What groups in your community do youVeel^'are not adequately provided with 
needed services from the library? 

Do you presently have active programs of IWrary outreach? 'Brle.fly descrijje 
which community groups they serve and in what way. (Atcach descripti^ 
documents if you prefer.) ' 

Do you already .have in mind a particular program of outreach on which you wish 
.to work during the OLN intititute program? What is it? 

" ""^9 - QLH- 5/72 



APPENDIX K 



WORKSHOP EVALUATION QUESTIONNAIRES 

I ^iode Island — final workshop -session 

1) What in the program 'did you finci most/least helpful? 

2) In what ways was the' staff helpful/not helpful? 

3) V]iat do yov suggest for improvement? 

Massachusetts — fin<al workshop session 

Did you find the Center to be a^good setting for a workshop? 
Why ot why not? 

What were your most important learnings during the workshop? 
Which aspects of the workshop helped you the most? 

a. Which of the objectives of the workshop was most fully 
realized, as you vievr the total group? 

b. Which the least? 

a; In what ways was thp. staff most helpful to you? 
b. Kox^ could they have I^een more helpful? 

Connecticut — distributed by mail 

"Feel free to add any comments you wish even if unrelated to these 
questions." 

What |>^^irt of the workshop was most helpful to you? * W^HY? 

What part of the workshop was least helpful to you? 

In what ways was the staff team most heJL^pful to you? 

In what ways was the staff team least helpful to you? 

Have you read or used the materials provided (e.g., worksheets,^ 
handouts, etc.)? How were they helpful? 

What suggestions would you have for changing the design of tue 
institute program (the preliminary activities, the worl.?hop 
activities, etc.)? (Respond on the back) 

OLN 6/72 

Northern States — final workshop session 

1) In what way did the prograru meet- vour needs? 

2) In what way did the program not meet your needo? 

3) a. In V7hat way was the s'tiaff most helpful? 

In what way was the staff least helpful? 

4) What couXd be*" helpful 'in follow-up for participants to do? 

For staff to do? . 

5) Comments. ^ 

An additional workshop evaluation of the Northern States Institute 
Program was distributed by mail. It is reproduced on the following page. 
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APPENDIX L 



POST INSTITJJTE SURVEY QUESTIONNAIRE 
PART A: ACTION PLANNING 

1. Hew did you idontify the unreached groups that bacame the target 
- population fcr your outreach effort? 

.2. Describe the activities that „eix or are being organized- lc invoi-« 
representatives of the target population in the needs' assessnent 
9r\£ project planning phaoes of the outreach effort. 

3. Identify other co.munity representatives that were involved in needs 
assessment and prcject planning. Briefly indicate why ^hey were 
selected, _ ^ 

4. Describe what you feel is the role of a helper (consultant) in the 
planning process. 

. G 

5. Please list. the major objectives of your outreach project and indicate 
the need which would be satisfied if each .objective vas realized. 

6. Pieaae indicate the approximate dates on which the following steps were 
compiatGd in che implementation of your library outreach action ilmi 

a. plan prepared _ . ' 

b. plan ra vised " - ■ 

c. plan completed *^ 



.d* plan submitted 

e. funds approved 

f- activity initiated 



7. %o is now responsible for directing your outxeacii program? Would 
the program continue if you left for a new assignment? 

8. Please write the titles of library action plans other than outre ach 
to which you have contributed? ~ 

9. If you^ad control of your library's resources, would you allocate 

/ / more ' 

/ / a:SS 

time and money to library outreach programs than you would have before 
you attended the institute? 

< 

10. Please list names, addressf,-. , and phone numbers of several people in your 
community who could provide information about the impact of your outreach 
program in -the community. 

11. Please describe the major problem that you have encountered in developing 
and implementing your outreach project. 

12. In what professional activities, other than outreach programs, Tiave you 
been able to use skills or ideas acquired during the Outreach Leadership 
Network institute program? . 

•■ ; • ^ = 

PART 3: PERSONAL SKILLS ASSESSMENT 

The following list reflects tL tyjjes of skilla that were considered in 
designing the program for the four institutes conducted by the Outreach 
Leadership Network staff. Your response to the following t^urvey will assist 
with the evaluation of the effectiveness of that project. 

OLN July, 1972 
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Please check the roost appropriate response, based on your judgement 
of the Qkills you acquired during the institute: 



SKILLS 



ERLC 



Skills in the planiiing process 

The ability to work through a 
prescribed problem-solving process 
and to develop an outline of* an 
action program directed toward 
a specific target group in the 
cotmnunity. 



2. Skills of outreach leadership 

The ability to articulate out- 
reach concepts in a convincing 
manner with colleagues and 
community people. The ability to^ 
initiate or help others initisce 
outreach ideas. 



Slcills of CO mmi>ai cation 

The ebilicy to effectively 
transmit and receive Ideas 
with others, individually 
ond in groups. 



ii» Skills in assessing community needs 

The ability to Identify community 
issues and describe potential tar- 
get groups 1:0 r library services in 
the community. TVje ability to re- 
late present and potential library 
services to respond to community 
issues. 

5. Skills of developing a working rela- 
tionship between yourself (or others) 
md the carget group. 

The ability to revise and modify 
your proposed action program by 
involving members of the selected 
target group. 



Stcills in seeking support and 
approval of your project. 

The ability to present a proposal 
to superiors or approval bodies 
(e.g. trustees) to "sell" an action 
plan; Tnfe ability to persuade and 
negotiate for such support and 
approval. 
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I ACQUIRED 

/ / A high level of new skills 

/ / Many new skills 

/ / Ccnje new skills ^ 

/ /' Few new skills 

/ / No new skills 

/ / A high level of new skills 

f^J Many new skills 

/ y Some new skills 

Few new skills 

/ / No new skilL<? 

yW A high level of new skills 
fj , Many ne^ skills 

/ / Some new skills 

/ / Few new skills 

/^J 1^0 new skills 

/ / A high level of new skills 

/ / Many new skills 

/ / Some new skills 
/ / . Few new skills 

7 _ / No new skills 



/ / A high level of aew skills 
/ / Many new skills 
/ / Some new skills 

/ Few new skills 
ZZT" No new skills 

c 

/ / A high level of new skills 
/ / Many new skills 
/ / Some new skills 
/ / Few new skills 
/ /. No new skills 

OLN July, 1972 



SKILLS 



I ACQUIRED 



7. SkllJs in defining using 

comniunl'ty resources^ 

The ability to find/use equipment , 
faciiltlfes, services, and money 
within the community to be used to 
contribute to the implementation 
of your action plan. 

8. Skills in discovering and using 

human resources. 

The ability to identify land Involve 
key community members in the data- 
gathering and 'data-sharing functions 
and in decision-making regarding the 
development of the plan. 

9. Skills in writing action plans-. 

. The ability to set down in writing, 
to translate the action-planning 
process into clear written form. 



10. Skills in using workshop techniques. 

The ability to translate techniques 
used in the workshops into the 
planning and implementation phases 
of your project. The ability, to 
Incorporate such techniques into 
forking relationships with colleagues 
and community groups-. 

11. Skills in implementing' action plans. 

The ability to. work with groups in 
order to facilitate their communica- 
tions and decicion-maklng within the 
action 'program. The ability to seek 
alternative ways of implementing the 
action plan in response to new infor- 
mation that becomes available before 
.and during the implementation stage. 

12. Skills in evaluating action plans. 

The ability to plan and measure 
success of action plans in terms 
of how objectives^ were met and • 
in terms of the effectiveness of 
the overall program. 



A high level of new 
n ^Many new skills 
Seme new skills 
Few nev skills 
No new skills 



L 

/ 

L 
/ 
/ 
/ 



A high level of new skills 
Many new skills 
Some new skills 
Few new skills 
No new skills 



skills 



A high level of new skills 
Many new skills 
Some nev skills 
Few new skills 
No new skills 

A high level of new skills 
Many new skills 
Some new skills 
Few new skills 
No new skills 

A high l^vel of new skills 
Many ney skills 
Some new skills 
Few new skills 
No new skills > 



A high level of new skills 
Many new skills 
Some new skills 
Few new skills 
No new skills 
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